douyin-live-proto

Open Source

Individual Role: Author & Schema Reverse-Engineer

An open-source Protocol Buffers schema repository and sanitized dataset providing verified message structures and offline unit-test payloads for streaming protocol deserialization.

GitHub: opedium/douyin-live-proto

Schemas: 85+ Message Types Defined

Validation: 61 Sanitized Sampling Payloads

View GitHub Repo

TECHNOLOGY STACK:

Google Protocol Buffers (.proto) Binary Serialization Network Packet Inspection Sanitized Test Suites Hex Payload Decoding

Reverse Engineering & Verification Flow

Raw Binary Frame

Hex Disassembly & Wire Tags

.proto Schema Construction

PII Data Anonymization

Automated Deserialization Testbed

Engineering Architecture & Scope

1. Binary Protocol Reverse-Engineering & Type Definitions

Reverse-engineered undocumented binary WebSocket message frames using hex-stream disassemblers and wire-type heuristic deduction.

Authored complete .proto definitions for over 85+ individual message types including chat messages, high-tier gifts, audience rankings, room statistics, and stream lifecycle events.
Identified nested sub-message hierarchies, enum definitions, and optional field tags without access to internal server schemas.
Established standardized build pipelines compiling schema files into Python, Go, and TypeScript target stubs.

syntax = "proto3";

message PushFrame {
    uint64 seq_id = 1;
    uint64 log_id = 2;
    uint64 service = 3;
    string payload_type = 7;
    bytes payload = 8;
}

2. Sanitized Unit-Test Corpus for Offline Protocol Testing

Curated and published a real-world testing corpus enabling developers to test deserializers without establishing live network connections.

Created 61 sanitized binary payloads covering edge-case message variants (multi-combo gifts, special unicode emojis, room moderation warnings).
Sanitized sensitive user metadata (PII, user IDs, real IP addresses) while preserving exact binary byte alignments and tag encodings.
Integrated automated test scripts validating that schema recompilation parses 100% of corpus payloads without decode exceptions.

3. Open-Source Ecosystem Impact

Standardized Protocol Buffer definitions enabling developers in the livestream analytics ecosystem to reliably parse binary frames without reverse-engineering schemas from scratch.

Maintained clear documentation and changelog records tracking upstream Douyin protocol version evolutions.
Provided cross-platform compilation instructions and Makefile targets for seamless developer adoption.