apache/hadoop

Yazar	SHA1 Mesaj	Tarih
Doug Cutting	d98cef1ab3 Fix HADOOP-100. Be more consistent about synchronization of access to taskTracker collection. Contributed by Owen O'Malley.	19 yıl önce
Doug Cutting	03c953c0dc Fix for HADOOP-107. As they were written, dfs blocks were both trickled to a datanode and tee'd to a temp file (in case the connection to the datanode failed). Now they're only written to the temp file, with no connection to the datanode made until the block is complete. This reduces the number of long-lived mostly-idle connections to datanodes, which was causing problems. It also simplifies the DFSClient code significantly.	19 yıl önce
Doug Cutting	294aa869c5 Fix for HADOOP-103, part II: I forgot to add this file the first time!	19 yıl önce
Doug Cutting	eeea2a252d Fix for HADOOP-103. Add a base class for Mapper and Reducer implementations that implements Closeable and JobConfigurable. Use it in supplied Mappers & Reducers. Also some minor improvements to demos. Contributed by Owen O'Malley.	19 yıl önce
Doug Cutting	7d0429d4d2 Fix for HADOOP-110. Reuse keys and values when mapping. Contributed by Owen O'Malley.	19 yıl önce
Doug Cutting	ec87d7e0e3 Fix for HADOOP-2. The combiner now clones keys and values, so mappers may now safely reuse emitted keys and values. Contributed by Owen O'Malley.	19 yıl önce
Doug Cutting	ecf45fd810 Fix for HADOOP-112. All operations on local files are now performed	19 yıl önce
Doug Cutting	7018745fac Fix for HADOOP-84. Improve error and log messages when block cannot be obtained by including file name and offset. Also removed a few unused variables. Contributed by Konstantin Shvachko.	19 yıl önce
Doug Cutting	95091af3ce Fix HADOOP-33. Avoid calling df too frequently by caching values internally. Contributed by Konstantin Shvachko.	19 yıl önce
Doug Cutting	4eccd587cc Fix HADOOP-67. Add a public API for dfs statistics. Also switch to use the public API for reporting in DFSShell.	19 yıl önce
Andrzej Bialecki	2948bf60de Add a tool for checking DFS consistency (HADOOP-101).	19 yıl önce
Doug Cutting	9f4fa16216 Fix for file names with spaces.	19 yıl önce
Doug Cutting	27a97ef6d3 Always return an absolute pathname for local files. This fixes	19 yıl önce
Doug Cutting	24465c6af4 Fix unit tests on Windows. Don't assume that, just because a pathname begins with a slash that it also returns true for File.isAbsolute(). Instead use getAbsoluteFile() to force such things to be absolute.	19 yıl önce
Doug Cutting	943ba3132a Document the new format command.	19 yıl önce
Doug Cutting	73be419f00 Fix for HADOOP-19. A namenode must now be formatted before it may be used. Attempts to start a namenode in an unformatted directory will fail, rather than automatically creating a new, empty filesystem, causing existing datanodes to delete all blocks. Thus a mis-configured dfs.data.dir should no longer cause data loss.	19 yıl önce
Doug Cutting	82236adb3c Move checking of output directory existence from JobClient to OutputFormat, so that it can be overridden. Add a base class for OutputFormat that implements this new method.	19 yıl önce
Doug Cutting	40644a69e6 Fix for HADOOP-46. Jobs can now be named. Contributed by Owen O'Malley.	19 yıl önce
Doug Cutting	2487ad9876 Fix for HADOOP-98. Keep more accurate task counts. Contributed by Owen O'Malley.	19 yıl önce
Doug Cutting	8cdc95ec9e Fix for HADOOP-52. Add username and working-directory to FileSystem and JobConf and use these to resolve relative paths. Contributed by Owen O'Malley.	19 yıl önce
Doug Cutting	f65655705b Fix for HADOOP-83.	19 yıl önce
Doug Cutting	78d2485bfb Much improved hadoop logo. Contributed by Stefan. Thanks!	19 yıl önce
Doug Cutting	f6db106b47 Fix for HADOOP-3. Don't permit jobs to write to a pre-existing output directory. Contributed by Owen O'Malley.	19 yıl önce
Doug Cutting	f1477b88fc Fix for HADOOP-45. Fatal task errors are now logged at the	19 yıl önce
Doug Cutting	df2d8df942 Fix for HADOOP-44. The error string for remote exceptions now contains the full remote stack trace. Remote exceptions are now also re-thrown on the client as RemoteException rather than IOException, so that they can be distinguished from other IOExceptions.	19 yıl önce
Doug Cutting	b8526a027f Start namenode before datanodes to minimize datanode startup errors.	19 yıl önce
Doug Cutting	9b0f9645d3 Fix for HADOOP-97. Improve error handling. Contributed by Konstantin Shvachko.	19 yıl önce
Doug Cutting	4d5fbc8ba2 Fix for HADOOP-87. Dont' pass large buffers through to deflater as this is inefficient.	19 yıl önce
Doug Cutting	7b5ab5946f Fix for HADOOP-93. Convert min split size from int to long, and permit its specification in the config.	19 yıl önce
Doug Cutting	74d3933823 Fix for HADOOP-86. Errors while reading map output now cause map task to fail and be re-executed.	19 yıl önce

Daha yeni Daha Eski

Geçmişin Kaydedilmesi Bul

Geçmişin Kaydedilmesi