Owen O'Malley
|
56f4f967cb
The old core branches are now common branches.
|
16 年之前 |
Doug Cutting
|
b52540f262
Moving branches to new location.
|
17 年之前 |
Doug Cutting
|
0077fb7333
Merge -r 390737:392453 from trunk, preparing for 0.1.1 release.
|
19 年之前 |
Doug Cutting
|
f0dd4ebc63
Update developer build version in branch.
|
19 年之前 |
Doug Cutting
|
bc897b8c84
Starting a branch for 0.1 releases.
|
19 年之前 |
Doug Cutting
|
0caa6bc1b1
More fixes to get working directory to work on Windows. Long-term we should stop using java.io.File for our abstract file paths. On Windows, 'new File(/foo/bar).isAbsolute()' returns false, which caused lots of problems. So I have added a FileSystem.isAbsolute() method that we use internally. I also added a few more .getAbsoluteFile() calls to convert paths into absolute paths so that LocalFileSystem works correctly. Finally I took advantage of file status information cached in DFSFile, eliminating some namenode RPCs.
|
19 年之前 |
Doug Cutting
|
f465056eb6
Fix wiki url.
|
19 年之前 |
Doug Cutting
|
09d93f190f
If close() fails, then abandon the file, so that any leases are
|
19 年之前 |
Doug Cutting
|
119226c1cb
Fix a bug where writing zero-length files would cause things to hang.
|
19 年之前 |
Doug Cutting
|
1740f0b0d4
DFS re-format should fully delete old namenode data.
|
19 年之前 |
Doug Cutting
|
3f5b4c0626
Fix for HADOOP-102. Contributed by Konstantin.
|
19 年之前 |
Doug Cutting
|
d98cef1ab3
Fix HADOOP-100. Be more consistent about synchronization of access to taskTracker collection. Contributed by Owen O'Malley.
|
19 年之前 |
Doug Cutting
|
03c953c0dc
Fix for HADOOP-107. As they were written, dfs blocks were both trickled to a datanode and tee'd to a temp file (in case the connection to the datanode failed). Now they're only written to the temp file, with no connection to the datanode made until the block is complete. This reduces the number of long-lived mostly-idle connections to datanodes, which was causing problems. It also simplifies the DFSClient code significantly.
|
19 年之前 |
Doug Cutting
|
294aa869c5
Fix for HADOOP-103, part II: I forgot to add this file the first time!
|
19 年之前 |
Doug Cutting
|
eeea2a252d
Fix for HADOOP-103. Add a base class for Mapper and Reducer implementations that implements Closeable and JobConfigurable. Use it in supplied Mappers & Reducers. Also some minor improvements to demos. Contributed by Owen O'Malley.
|
19 年之前 |
Doug Cutting
|
7d0429d4d2
Fix for HADOOP-110. Reuse keys and values when mapping. Contributed by Owen O'Malley.
|
19 年之前 |
Doug Cutting
|
ec87d7e0e3
Fix for HADOOP-2. The combiner now clones keys and values, so mappers may now safely reuse emitted keys and values. Contributed by Owen O'Malley.
|
19 年之前 |
Doug Cutting
|
ecf45fd810
Fix for HADOOP-112. All operations on local files are now performed
|
19 年之前 |
Doug Cutting
|
7018745fac
Fix for HADOOP-84. Improve error and log messages when block cannot be obtained by including file name and offset. Also removed a few unused variables. Contributed by Konstantin Shvachko.
|
19 年之前 |
Doug Cutting
|
95091af3ce
Fix HADOOP-33. Avoid calling df too frequently by caching values internally. Contributed by Konstantin Shvachko.
|
19 年之前 |
Doug Cutting
|
4eccd587cc
Fix HADOOP-67. Add a public API for dfs statistics. Also switch to use the public API for reporting in DFSShell.
|
19 年之前 |
Andrzej Bialecki
|
2948bf60de
Add a tool for checking DFS consistency (HADOOP-101).
|
19 年之前 |
Doug Cutting
|
9f4fa16216
Fix for file names with spaces.
|
19 年之前 |
Doug Cutting
|
27a97ef6d3
Always return an absolute pathname for local files. This fixes
|
19 年之前 |
Doug Cutting
|
24465c6af4
Fix unit tests on Windows. Don't assume that, just because a pathname begins with a slash that it also returns true for File.isAbsolute(). Instead use getAbsoluteFile() to force such things to be absolute.
|
19 年之前 |
Doug Cutting
|
943ba3132a
Document the new format command.
|
19 年之前 |
Doug Cutting
|
73be419f00
Fix for HADOOP-19. A namenode must now be formatted before it may be used. Attempts to start a namenode in an unformatted directory will fail, rather than automatically creating a new, empty filesystem, causing existing datanodes to delete all blocks. Thus a mis-configured dfs.data.dir should no longer cause data loss.
|
19 年之前 |
Doug Cutting
|
82236adb3c
Move checking of output directory existence from JobClient to OutputFormat, so that it can be overridden. Add a base class for OutputFormat that implements this new method.
|
19 年之前 |
Doug Cutting
|
40644a69e6
Fix for HADOOP-46. Jobs can now be named. Contributed by Owen O'Malley.
|
19 年之前 |
Doug Cutting
|
2487ad9876
Fix for HADOOP-98. Keep more accurate task counts. Contributed by Owen O'Malley.
|
19 年之前 |