scratching your own itch

17
November 2011 Scratching your own itch Joey Echeverria | Solutions Architect [email protected] @fwiffo

Upload: joey-echeverria

Post on 05-Jul-2015

111 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: Scratching your own itch

November 2011

Scratching your own itchJoey Echeverria | Solutions Architect

[email protected]

@fwiffo

Page 2: Scratching your own itch

About Joey

• Solutions Architect

• 6 months

• 3+ years

©2011 Cloudera, Inc. All Rights Reserved.

2

Page 3: Scratching your own itch

Why Apache Sqoop (incubating)?

• Data center integration

• Extensible

– Sources

– Destinations

• Company specific

• Open source

– Yay!

©2011 Cloudera, Inc. All Rights Reserved.

3

Page 4: Scratching your own itch

Getting the code

• Apache SVN

– https://svn.apache.org/repos/asf/incubator/sq

oop/

• Apache GIT

– http://git.apache.org/sqoop.git

• GitHub

– https://github.com/apache/sqoop.git

©2011 Cloudera, Inc. All Rights Reserved.

4

Page 5: Scratching your own itch

Fork you

©2011 Cloudera, Inc. All Rights Reserved.

5

Page 6: Scratching your own itch

Building the code

• Requirements

– Ant 1.7.1

– JDK 1.6

– Maven• SQOOP-306

• Targets

– jar

– test

– checkstyle

©2011 Cloudera, Inc. All Rights Reserved.

6

Page 7: Scratching your own itch

Checkstyle

©2011 Cloudera, Inc. All Rights Reserved.

7

Page 8: Scratching your own itch

IDE

©2011 Cloudera, Inc. All Rights Reserved.

8

Page 9: Scratching your own itch

Testing

• JUnit

• By hand

– ant package

– cd build/sqoop-1.5-incubating-SNAPSHOT

– bin/sqoop

©2011 Cloudera, Inc. All Rights Reserved.

9

Page 10: Scratching your own itch

Contributing back: Why?

• Next release

• Lower long-term cost

• For the community!

• It’s easier than you think!

©2011 Cloudera, Inc. All Rights Reserved.

10

Page 11: Scratching your own itch

Fears

• People won’t want my patch

– Rare

– Small projects

• Only I need this feature

– That’s what everyone says…

• Too much process!

– A little time now, a massive headache later

©2011 Cloudera, Inc. All Rights Reserved.

11

Page 12: Scratching your own itch

Sqoop vs. HDFS

• Small project

– Less contentious

– Easier to grok the code

– Easy deployment

• Immediate feedback

• Great place to start

©2011 Cloudera, Inc. All Rights Reserved.

12

Page 13: Scratching your own itch

Contributing back: How?

• File a JIRA

– https://issues.apache.org/jira/browse/SQOOP

• Post your patch on the issue

• File a review request

– https://reviews.apache.org/groups/Sqoop/

©2011 Cloudera, Inc. All Rights Reserved.

13

Page 14: Scratching your own itch

Posting patches

©2011 Cloudera, Inc. All Rights Reserved.

14

Page 15: Scratching your own itch

The review process

• Upload your patch

• Describe your changes

• Describe your testing

• Wait for feedback

• Repeat

©2011 Cloudera, Inc. All Rights Reserved.

15

Page 16: Scratching your own itch

What else?

• Subscribe to the mailing list

[email protected]

• Look for open issues

– https://issues.apache.org/jira/browse/SQOOP

• Get hacking

©2011 Cloudera, Inc. All Rights Reserved.

16

Page 17: Scratching your own itch

Questions?

©2011 Cloudera, Inc. All Rights Reserved.

17