scratching your own itch
TRANSCRIPT
November 2011
Scratching your own itchJoey Echeverria | Solutions Architect
@fwiffo
About Joey
• Solutions Architect
• 6 months
• 3+ years
©2011 Cloudera, Inc. All Rights Reserved.
2
Why Apache Sqoop (incubating)?
• Data center integration
• Extensible
– Sources
– Destinations
• Company specific
• Open source
– Yay!
©2011 Cloudera, Inc. All Rights Reserved.
3
Getting the code
• Apache SVN
– https://svn.apache.org/repos/asf/incubator/sq
oop/
• Apache GIT
– http://git.apache.org/sqoop.git
• GitHub
– https://github.com/apache/sqoop.git
©2011 Cloudera, Inc. All Rights Reserved.
4
Fork you
©2011 Cloudera, Inc. All Rights Reserved.
5
Building the code
• Requirements
– Ant 1.7.1
– JDK 1.6
– Maven• SQOOP-306
• Targets
– jar
– test
– checkstyle
©2011 Cloudera, Inc. All Rights Reserved.
6
Checkstyle
©2011 Cloudera, Inc. All Rights Reserved.
7
IDE
©2011 Cloudera, Inc. All Rights Reserved.
8
Testing
• JUnit
• By hand
– ant package
– cd build/sqoop-1.5-incubating-SNAPSHOT
– bin/sqoop
©2011 Cloudera, Inc. All Rights Reserved.
9
Contributing back: Why?
• Next release
• Lower long-term cost
• For the community!
• It’s easier than you think!
©2011 Cloudera, Inc. All Rights Reserved.
10
Fears
• People won’t want my patch
– Rare
– Small projects
• Only I need this feature
– That’s what everyone says…
• Too much process!
– A little time now, a massive headache later
©2011 Cloudera, Inc. All Rights Reserved.
11
Sqoop vs. HDFS
• Small project
– Less contentious
– Easier to grok the code
– Easy deployment
• Immediate feedback
• Great place to start
©2011 Cloudera, Inc. All Rights Reserved.
12
Contributing back: How?
• File a JIRA
– https://issues.apache.org/jira/browse/SQOOP
• Post your patch on the issue
• File a review request
– https://reviews.apache.org/groups/Sqoop/
©2011 Cloudera, Inc. All Rights Reserved.
13
Posting patches
©2011 Cloudera, Inc. All Rights Reserved.
14
The review process
• Upload your patch
• Describe your changes
• Describe your testing
• Wait for feedback
• Repeat
©2011 Cloudera, Inc. All Rights Reserved.
15
What else?
• Subscribe to the mailing list
• Look for open issues
– https://issues.apache.org/jira/browse/SQOOP
• Get hacking
©2011 Cloudera, Inc. All Rights Reserved.
16
Questions?
©2011 Cloudera, Inc. All Rights Reserved.
17