cept: collaborative editing tool for non-native...
TRANSCRIPT
-
CEPT: Collaborative Editing Tool for Non-Native Authors
Yeshuang Zhu, Shichao Yue, Chun Yu, Yuanchun Shi
http://pi.cs.tsinghua.edu.cn
-
Background
• Language editing is important and necessary for L2 writing.
• L2 problems: word choice, style, and L1 interference. (Park, T., et al. UIST 2008)
-
Background
• Language editing is important and necessary for L2 writing.
• L2 problems: word choice, style, and L1 interference.
• Language service by experts is not the first option.
• Considerations: cost, delay, domain mismatch, etc.
(Park, T., et al. UIST 2008)
-
Background
• Language editing is important and necessary for L2 writing.
• L2 problems: word choice, style, and L1 interference.
• Language service by experts is not the first option.
• Considerations: cost, delay, domain mismatch, etc.
• Collaborative editing (CE) is most often adopted by NNSs.
(Park, T., et al. UIST 2008)
-
Two Is Better than One
-
Two Is Better than One
• Collaborators have different and complementary knowledge about how to improve the writing.
(Piaget, J. On the development of memory and identity, 1968)
-
Two Is Better than One
• Collaborators have different and complementary knowledge about how to improve the writing.
• Picking from alternatives (recognition) is easier than generating new ones (recall).
(Winke, P. Studies in Second Language Acquisition, 2007)
(Piaget, J. On the development of memory and identity, 1968)
-
Tools for Collaborative Writing and Editing
-
Tools for Collaborative Writing and Editing
Email + edit mode
-
Tools for Collaborative Writing and Editing
Email + edit mode
(Noël, S., et al. CSCW 2004)
Online (synchronous) document
-
Tools for Collaborative Writing and Editing
Email + edit mode
(Noël, S., et al. CSCW 2004)
Online (synchronous) document
(Tomlinson, B., et al. CHI EA 2012)
Version control
-
Tools for Collaborative Writing and Editing
Email + edit mode
(Noël, S., et al. CSCW 2004)
Online (synchronous) document
(Tomlinson, B., et al. CHI EA 2012)
Version control
None is specially designed for language editing
-
Why Not Synchronous Document?
-
Why Not Synchronous Document?
• Edit mode is hard to interpret and share
-
Why Not Synchronous Document?
• Edit mode is hard to interpret and share
• Different opinions are not welcomed by nature
(Birnholtz, J., et al. CSCW 2012)
-
Why Not Synchronous Document?
Contribution in CEKnowledge in language
NNS 2
NNS 1
NNS 3
-
From Single Version to Parallel
-
From Single Version to Parallel
-
From Single Version to Parallel
-
Multi-Versioning: A Pilot Study
-
• Four Google Docs placed in parallel
SettingsP1 P2
P3 P4
-
• Four Google Docs placed in parallel
• Participants could:• edit their own copy only• refer to others• commenting on others
SettingsP1 P2
P3 P4
-
P1 P2
P3 P4
Lessons Learned
-
P1 P2
P3 P4
Lessons Learned
• Edit mode is hard to interpret• Full of strike-throughs
-
P1 P2
P3 P4
Lessons Learned
• Edit mode is hard to interpret• Full of strike-throughs
• Mess of multiple versions• Difficult to locate areas concerned
-
P1 P2
P3 P4
Lessons Learned
• Edit mode is hard to interpret• Full of strike-throughs
• Mess of multiple versions• Difficult to locate areas concerned
• Lack of interaction• Direct with the edits
-
CEPT - Design ?
-
CEPT - Interface DesignOverview
-
CEPT - A Use CaseStep #1: Alice Uploads an Essay
And She invites 3 friends to help:Bob, Carol, and Dave
-
CEPT - A Use CaseStep #2: Bob Edits on His Own
-
CEPT - A Use CaseStep #3: More Editors Join (Carol and Dave)
-
CEPT - A Use CaseStep #4: Alice Aggregates the Revisions
-
CEPT - A Use CaseStep #4: Alice Aggregates the Revisions
-
CEPT - Four Design Features
-
Feature #1: Aligned Sentences View
-
Feature #1: Aligned Sentences View
User sentence
-
Feature #1: Aligned Sentences View
User sentence
Automatic summary of revisions
-
Feature #1: Aligned Sentences View
User sentence
Automatic summary of revisions
Revision with cross-sentence edits
-
Feature #1: Aligned Sentences View
User sentence
Automatic summary of revisions
Revision with cross-sentence edits
Details of each summarized revision
-
Beyond Sentences
Many to one (Sentences are merged by others)
One to many (Sentences are merged by me)
-
Beyond Sentences
Many to one (Sentences are merged by others)
One to many (Sentences are merged by me)
-
Beyond Sentences
One to zero (One sentence is deleted by others)
Zero to one (New sentence is inserted by others)
-
Beyond Sentences
One to zero (One sentence is deleted by others)
Zero to one (New sentence is inserted by others)
-
Feature #2: Refined Edit Presentation
1. Newton lost himsself in thought of the relation between objects.
2. Newton lost himssself in thought of the relation between objects.
3. Newton lost himhisself in thought of the relation between objects.
4. Newton lost himselfhisself in thought of the relation between objects.
(Raw tracking)
(Raw tracking)
(Raw tracking)
(Word-level diff-ing)
-
Feature #2: Refined Edit Presentation
1. Newton lost himsself in thought of the relation between objects.
2. Newton lost himssself in thought of the relation between objects.
3. Newton lost himhisself in thought of the relation between objects.
4. Newton lost himselfhisself in thought of the relation between objects.
(Raw tracking)
(Raw tracking)
(Raw tracking)
(Word-level diff-ing)
-
Toggle Visibility of Deleted Text
-
Toggle Visibility of Deleted Text
-
Toggle Visibility of Deleted Text
-
Toggle Visibility of Deleted Text
-
Feature #3: Edit Summarization
…
-
Feature #3: Edit Summarization
…
-
Feature #4: Interaction with Others
-
Feature #4: Interaction with Others
-
Feature #4: Interaction with Others
-
CEPT - Implementation
-
Technique #1: Sentence Mapping
S1 S2 S3 S4 S5
S1' S2', S3' S4 Snew S5'V1:
V0:
-
Example
1
2
3
4
5
-
1) Edit in Sentences
1
2
3
4
5
-
2) Insert A Sentence
1
2
3
4
5
-
2) Insert A Sentence
1
2
3
4
5
?
-
3) Remove A Sentence
1
2
3
4
5
-
3) Remove A Sentence
1
2
3
4
5
-
Technique #2: Edit Summary and Borrowing
Sharing their lives on social media becomes really necessary.Alice:
Sharing their lives on social media becomes really necessary.Bob:
Sharing their lives on social media becomes really necessary.Carol:
-
Technique #2: Edit Summary and Borrowing
Sharing their lives on social media becomes really necessary.Alice:
Sharing their lives on social media becomes really necessary.Bob:
Sharing their lives on social media becomes really necessary.Carol:
Sharing their lives on social media becomes really necessary.excessive
-
Technique #2: Edit Summary and Borrowing
Sharing their lives on social media becomes really necessary.Alice:
Sharing their lives on social media becomes really necessary.Bob:
Sharing their lives on social media becomes really necessary.Carol:
Sharing their lives on social media becomes really necessary.excessive
Sharing their lives on social media becomes really necessary.over acting
-
Technique #2: Edit Summary and Borrowing
Sharing their lives on social media becomes really necessary.Alice:
Sharing their lives on social media becomes really necessary.Bob:
Sharing their lives on social media becomes really necessary.Carol: Sharing their lives on social media becomes really necessary.takes too much time
Sharing their lives on social media becomes really necessary.excessive
Sharing their lives on social media becomes really necessary.over acting
-
Technique #2: Edit Summary and Borrowing
Sharing their lives on social media becomes really necessary.Alice:
Sharing their lives on social media becomes really necessary.Bob:
Sharing their lives on social media becomes really necessary.Carol: Sharing their lives on social media becomes really necessary.takes too much time
Sharing their lives on social media becomes really necessary.becomes excessive
Sharing their lives on social media becomes really necessary.becomes over acting
-
Technique #2: Edit Summary and Borrowing
Carol: Sharing their lives on social media becomes really necessary.takes too much time
Alice: Sharing their lives on social media becomes really necessary.becomes excessive
Bob: Sharing their lives on social media becomes really necessary.becomes over acting
Summarized: Sharing their lives on social media becomes really necessary .3
-
Preliminary Evaluation
-
Interface #1: CEPT
-
Interface #2: Baseline
-
Design
…Initial revision Final revision Quality Evaluation
1 NS rater12 NNS participants3 NNS "Collaborators"
2 paragraphs
-
Design
…Initial revision Final revision Quality Evaluation
1 NS rater12 NNS participants3 NNS "Collaborators"
2 paragraphs
12 “quartets”
-
Results
-
Results
• CEPT improves edit quality more than a plain interface:• Reducing 18% more errors (t11 = −2.54, p < .05)
-
Results
• CEPT improves edit quality more than a plain interface:• Reducing 18% more errors (t11 = −2.54, p < .05)
• Two is better than one:• 9 out of 12 cases 4-NNSs could outperform a NS.
-
Results
• CEPT improves edit quality more than a plain interface:• Reducing 18% more errors (t11 = −2.54, p < .05)
• Two is better than one:• 9 out of 12 cases 4-NNSs could outperform a NS.
• CEPT draws intensive interaction• And also receives strong subjective preference.
-
Future Work: Field Deployment
-
CEPT: Collaborative Editing Tool for Non-Native Authors
Yeshuang Zhu, Shichao Yue, Chun Yu, Yuanchun Shi
http://pi.cs.tsinghua.edu.cn