serialization (avro, message pack, kryo)

13
Serialization Avro, Message Pack, Kryo Han O Seok

Upload: -

Post on 14-Apr-2017

545 views

Category:

Technology


2 download

TRANSCRIPT

Page 1: Serialization (Avro, Message Pack, Kryo)

SerializationAvro, Message Pack, Kryo

Han O Seok

Page 2: Serialization (Avro, Message Pack, Kryo)

What is Serialization?

Page 3: Serialization (Avro, Message Pack, Kryo)

What is Serialization?

Page 4: Serialization (Avro, Message Pack, Kryo)
Page 5: Serialization (Avro, Message Pack, Kryo)

Avro

• Apache Foundation

• JSON defineded Schema

Page 6: Serialization (Avro, Message Pack, Kryo)

Avro

• Created by Doug Cutting, the Creator of Hadoop

• Data is always accompanied by a schema- Support for dynamic typing-code generation is not required

Page 7: Serialization (Avro, Message Pack, Kryo)

Performance of Avro

• Avro is not the fastest, But is in the top half

Page 8: Serialization (Avro, Message Pack, Kryo)

Message Pack

• Rich data structures - JSON

• Interface Definition Language(IDL) - thrift

• Create Schema Based Annotaion

• RPC Sync, Async Support Event-Driven I/O

Page 9: Serialization (Avro, Message Pack, Kryo)

Format of Message Pack

Page 10: Serialization (Avro, Message Pack, Kryo)

Performance of Message Pack

Page 11: Serialization (Avro, Message Pack, Kryo)

Kryo

• Google Code

• Easy to Collect Serializers Case By Class

• Support Compression

• Kryo TCP & UDP client/server library

Page 12: Serialization (Avro, Message Pack, Kryo)

Benchmarking V2

• http://code.google.com/p/thrift-protobuf-compare/wiki/BenchmarkingV2

Page 13: Serialization (Avro, Message Pack, Kryo)

Thanks :)