There are so many DataObjects / Actions, how do I get started?
Common use cases are included in the sdl-examples project, check out its application.conf. This should give you a good overview of how to use data objects and actions. Then check the Reference to see which types of data objects and actions are currently supported.
How can I test Hadoop / HDFS locally ?
local:// URIs, file permissions on Windows, or certain actions, local Hadoop binaries are required.
- Download your desired Apache Hadoop binary release from https://hadoop.apache.org/releases.html.
- Extract the contents of the Hadoop distribution archive to a location of your choice, e.g.,
- Set the environment variable
- Windows only: Download a Hadoop winutils distribution corresponding to your Hadoop version from https://github.com/steveloughran/winutils (for newer Hadoop releases at: https://github.com/cdarlint/winutils) and extract the contents to