Doug Cutting
|
dc207a0a5a
Fix for HADOOP-70. Unit tests should have their own hadoop-site.xml and mapred-default.xml, so that local modifications to these files in conf/ don't alter unit testing. Also rename TestDFS so that it is not normally run, and add a new test target which runs tests using the config files in conf/.
|
hace 19 años |
Doug Cutting
|
a2619cc401
Reverted changes from 384385, which removed local backup copy of block & removed most timeouts. That worked well when all hosts are healthy, but when a few are very slow it caused too many tasks to timeout and loads to balloon on slow hosts. So the local backup is back, but no longer in /tmp, rather in dfs.data.dir, and timeouts are back. I also added connect timeouts, so that dfs connects also don't get hung up by slow hosts.
|
hace 19 años |
Doug Cutting
|
bbc74dd53e
Fixed wiki URL.
|
hace 19 años |
Doug Cutting
|
a18fc6b1ef
Fixed wiki URL.
|
hace 19 años |
Doug Cutting
|
7dd5fc4a7d
Fix for HADOOP-66. DFS blocks are no longer written to local temp files. If a connection to a datanode fails then an exception is now thrown, rather than trying to re-connect to another datanode. Timeouts were also removed from datanode connections, since these caused a lot of failed connections.
|
hace 19 años |
Doug Cutting
|
45d0820258
Add ability to sleep a bit between each command that's submitted to a slave, to meter slave commands a bit.
|
hace 19 años |
Doug Cutting
|
7fd5df0c88
Fix for HADOOP-57. Permit listing of "/" in dfs. With help from Mahadev konar.
|
hace 19 años |
Andrzej Bialecki
|
2e0f1051ff
Apply local Configuration to parameters received via RPC if they
|
hace 19 años |
Doug Cutting
|
b79a449a6a
Increase deflater & inflater buffer size, for better performance.
|
hace 19 años |
Doug Cutting
|
9c70ec2b42
Reduce iteration through all map & reduce tasks to improve jobtracker performance.
|
hace 19 años |
Doug Cutting
|
6798d42774
Replace an NPE with an informative warning.
|
hace 19 años |
Doug Cutting
|
a6b0291c8d
Increase some intervals to further reduce stress on the jobtracker.
|
hace 19 años |
Doug Cutting
|
e25b16bdbb
Don't always query jobtracker for all needed map outputs, instead just
|
hace 19 años |
Michael John Cafarella
|
fc9de14372
|
hace 19 años |
Michael John Cafarella
|
dce8c9cf6a
|
hace 19 años |
Michael John Cafarella
|
71eec3a52c
|
hace 19 años |
Doug Cutting
|
7d178223d6
Fix a couple of tasktracker bugs.
|
hace 19 años |
Michael John Cafarella
|
fa1635cb55
|
hace 19 años |
Doug Cutting
|
e41e5cd78e
Check taskid's more carefully. Suggested by Michael Stack.
|
hace 19 años |
Doug Cutting
|
49601bd8c1
Fix for HADOOP-16. Splitting and other job planning is now performed in a separate thread.
|
hace 19 años |
Doug Cutting
|
816215d79c
Upgrade to Lucene 1.9.1.
|
hace 19 años |
Doug Cutting
|
9ef99db0ed
Fix for HADOOP-60, with help from Owen & Michael.
|
hace 19 años |
Doug Cutting
|
472b093bcc
Permit folks to modify options passed to ssh. For example, older versions of ssh do not support the ConnectTimeout option.
|
hace 19 años |
Doug Cutting
|
9fa21cffcb
Add webapps to classpath so they're found.
|
hace 19 años |
Doug Cutting
|
5c13c7170f
Fix rsync command to (a) use ssh as transport, and (b) to correctly
|
hace 19 años |
Doug Cutting
|
19f692e553
Fix to make independent of "unzip", using java's built in unzip code instead.
|
hace 19 años |
Doug Cutting
|
5c70b644c6
Fix command line (again!).
|
hace 19 años |
Doug Cutting
|
0925dc8d94
Update example command line.
|
hace 19 años |
Doug Cutting
|
3c4edc2643
Un-escape containing jar's path, which is URL-encoded. This fixes
|
hace 19 años |
Doug Cutting
|
e3970330a9
Escape paths so that spaces are permitted (as is common on Windows.)
|
hace 19 años |