src-d / okrs

Objectives & Key Results repository for the source{d} team

source{d} OKRs

Methodology

• source{d} OKR methodology

Previous quarters OKRs

• 2018-1Q
• 2018-2Q
• 2018-3Q
• 2018-4Q

okrs's Issues

Remove technical friction between multiple teams

Parent objective: #4
Progress: 0%

• [P0] Introduce monthly empathy sessions or other mechanism where different teams get to try other teams' tools

Increasing the # of users of the source{d} stack

Parent objective: #2
Progress: 0%

• [P0] Make MLonCode a thing #49
• [P0] Make source{d} the face of MLonCode #50
• [P0] Make source{d} the lead of MLonCode research #42
• [P0] Make source{d} the to-go place for MLonCode models #44
• [P0] Release updated content for sourced.tech #13

Create a content strategy plan

Parent objective: #13
Progress: 0%

• [P0] Editorial Environment Setup
• [P0] Customer Journeys
• [P0] Content Model
• [P0] Copywriting
• [P0] Metrics & Evaluation Analytics Setup
• [P1] Information Architecture
• [P2] Establish a Content Management Plan

Make gitbase suitable to run over PGA

Parent objective: #8
Progress: 4/4

• [P0] Make gitbase better suited for rooted repositories
• [P0] Make gitbase queries on PGA not crash
• [P1] Instrument gitbase to be able to trace performance
• [P1] Improve performance of gitbase over PGA

Keep repositories never more than 30 days outdated

Parent objective: #5
Progress: 0%

• [P1] Optimize borges to keep up with all repository updates within 30 days #27

Increase social engagement with #MLonCode

Parent objective: #10
Progress: 0%

• [P0] Increase hashtag usage on social media channels by X% (TBD with #48)

(ongoing)

• [P0] Identify 20 blog posts / papers on the topic written by others, propose cross-posting to our blog/medium
• [P1] Identify 10 speakers at conferences talking about #MLonCode, invite them for collaboration / tweet about their talks / partner with them
• [P2] post 10 times a week in our multiple social media accounts about #MLonCode
• [P2] create a strategy to manage our online communities (slack, etc) and corresponding online marketing

Having successful users of source{d}

Parent objective: #1
Progress: 0%

• [P0] Partner with source{d} users #46
• [P0] Users are able to successfully download, filter & process PGA to extract roles & semantic concepts using XPath #11
• [P0] Users are in a simple and language-agnostic way able to analyze git repositories and interact with UASTs #8
• [P0] Users are able to identify file-level similarity on a large scale as our first application launch #54
• [P0] Deliver a reference implementation of function-level similarity #43
• [P0] Contributors of selected open-source repositories will receive source{d} bot recommendations on pull requests #9
• [P0] Increasing the # of users of the source{d} stack #10

Define the code review application product

Parent objective: #2
Progress: 0%

• [P0] Define use key cases and choose one for PoC
• [P0] Specify features
• [P0] Specify architecture

Apply new Visual Style to sourced.tech

Parent objective: #13
Progress: 0%

• [P0] Visual Artifacts Study
• [P1] Research
• [P1] Chromatic Palete Study
• [P1] Typography Study
• [P1] Initial Proposals
• [P1] Pure css update PR

Store pipeline cluster logs in a queryable manner

Parent objective: #59
Progress: 0%

• [P0] Store logs
• [P1] Be able to query logs

Higher-level categories for nodes

Parent objective: #20
Progress: 0%

• [P0] Annotate similar roles with additional category role
  • Loops
    // TODO

UAST structure normalization

Parent objective: #21
Progress: 2/4

• [P0] Refactor SDK to better support structure manipulation (bblfsh/sdk#240)
• [P0] Design and implement transformation DSL (bblfsh/sdk#241)
• [P0] Port existing annotation code (bblfsh/sdk#244)

Make engine suitable to run over PGA

Parent objective: #11
Progress: 100%

• [P0] Fix the reported errors and do not crash
• [P1] Report errors with meaning information for tracing the root causes

Partner with source{d} users

Parent objective: #2
Progress: 0%

• [P0] Partner with 4 strategic users (2 in academia / 2 in industry) and provide guides / workshops / samples as they need them
• [P1] Meet with those users monthly and gather feedback from their experience
• [P1] Write friction logs / blog posts from their failure / success stories

Store all public repositories from GitHub, BitBucket and self-hosted cgit

Parent objective: #5
Progress: 75%

• [P0] Stable pipeline with rovers and borges
• [P0] Get computing and storage production-ready cluster to 60 machines (30%)

Vision: Being the leading company for ML on Code

Parent objective: N/A
Progress: 0%

Users are able to work with PGA

Parent objective: #2
Progress: 1/3

• [P0] Make engine suitable to run over PGA #17
• [P0] Make UAST usable without extensive knowledge of Babelfish #12
• [P1] Set PGA update policy and perform it #41

Release updated content for sourced.tech

Parent objective: #10
Progress: 0%

• [P0] Create a content strategy plan #35
• [P1] Update brand touchpoints according to content plan
• [P1] Apply new Visual Style to sourced.tech #32
• [P1] Write 2 blog posts in 2Q18 #38

Make source{d} the face of #MLonCode

Parent objective: #10
Progress: 0%

• [P0] Develop half a day workshop on getting started with #MLonCode with source{d} stack (PGA, gitbase?, engine, etc)
• [P1] Run that workshop at least once at a meetup / conference
• [P0] Create a new talk on the future of #MLonCode and deliver it at least four times (existing confs and meetups)
• [P1] Make that workshop and talk available online
• [P1] Create two demos showing the power of our stack solving a “real problem”
• [P2] Determine what percentage of time source{d} engineers should spend working on docs/tutorials/talks/etc

Deliver a reference implementation of function-level similarity

Parent objective: #2
Progress: 0%

• [P0] Update the Code Annotation tool for function-level support #57
• [P0] Annotate the dataset of 500 pairs of Java functions
• [P0] Find the best hyperparameters

Publish source{d}'s Brand Persona case-study development post on Medium

Parent objective: #13
Progress: 0%

• [P0] Write a blog post regarding the process, methodologies and output on the source{d}'s Brand Persona.

Launch higher level UAST abstractions for Babelfish

Parent objective: #12
Progress: 50%

• [P0] Higher-level APIs to list simple constructs (functions, classes, etc). #21
• [P1] Higher-level categories for nodes.
• [P2] Structural pointers.

Define a format that can store UAST in a space-efficient way

Parent objective: #18
Progress: 15%

• [P0] Get current UAST format stats for PGA in comparison with source file sizes.
• [P0] Try different approaches for storing UAST (binary, string tables, etc).

Determine which product category (Security & Compliance, Automated Code Review, or QA & Testing)

Parent objective: #3
Progress: 0%

• [P0] Conduct market research on the categories
• [P1] Deliver structured user research #7

Improve performance of gitbase over PGA

Parent objective: #16
Progress: 0/0

• [P0] Key result 1
• [P1] Key result 2
• [P0] Key result n

Cover top 10 languages from the most used list on StackOverflow's developer survey

Parent objective: #2
Progress: 0/4

• [P1] C# driver.
• [P1] Typescript driver.
• [P1] C/C++ driver.
• [P2] Swift driver.

Make our interview process more remote friendly

Parent objective: #4
Progress: 2/3

• [P0] Conduct 2 on-site interviews with an interviewer being remote during the candidate is on-site
• [P1] Plan detailed steps of the fully-remote interviews to be applied in Q3
• [P1] Tune the process with what we learned from these interviews #55

Store the world’s source code

Parent objective: #1
Progress: 0%

• [P0] Store all public repositories from GitHub, BitBucket and self-hosted cgit #14
• [P1] Keep repositories never more than 30 days outdated #15

Build a go-to-market strategy

Parent objective: #1
Progress: 1%

• [P0] Determine which product category (Security & Compliance, Automated Code Review, or QA & Testing) #6
• [P0] Determine licensing strategy
• [P0] Determine go-to-market model
• [P1] Determine early pricing approach

Higher-level APIs to list simple AST constructs

Parent objective: #20
Progress: 0%

• [P0] UAST structure normalization
• [P0] Port all existing beta language drivers

Hire for each open role

Parent objective: #4
Progress: 3/5

• [P0] Attract relevant profiles of applicants through developer community
• [P1] Make one hire for each open role
• [P1] Increase candidate’s motivation and engagement at every interviewing step
• [P1] Have a quick process from our side
• [P1] Gain feedback from the candidates for the hiring process

Develop a remote on-boarding process

Parent objective: #4
Progress: 100%

• [P1] Gain feedback on onboarding from every member who joined after the current implementation of onboarding guide
• [P1] Have a complete onboarding guide on GitHub

Launch gitbase and its playground

Parent objective: #2
Progress: 0%

• [P0] Launch a beta version of the single node version of gitbase #16
• [P0] Design gitbase playground #39
• [P0] Build gitbase playground #51
• [P1] Get over 2/3 of user positive feedback

Make source{d} the lead of MLonCode research

Parent objective: #10
Progress: 0%

• [P0] Create and maintain a research log with TL;DR summaries of research read (read, write a summary, find how this can help problems we try to solve at source{d})
• [P1] Publish 6 ML blog posts in Q2
• [P2] Speak about ML on >4 relevant conferences
• [P2] Reach 1,000 cumulative upvotes of new blog posts on Reddit

Set PGA update policy and perform it

Parent objective: #11
Progress: 0%

• [P0] Specify the updates and versioning policy.
• [P1] Add the regular PGA dataset update job to the full-scale data pipeline.

Facilitate UAST-based tasks on PGA

Parent objective: #11
Progress: 0%

• [P0] Create UAST dataset based on PGA consumable by ML team
• [P0] Define a format that can store UAST in a space-efficient way
• [P1] Publish UAST dataset
• [P2] Publish an index for the UAST dataset that DevRel can use to improve download criteria for it

Make UAST usable without extensive knowledge of Babelfish

Parent objective: #11
Progress: 0%

• [P0] Launch higher level UAST abstractions for Babelfish #20
• [P0] Update bblfsh playground #56
• [P0] Have over 2/3 of key users to report feature as satisfactory

Explore interaction flows with developers

Parent objective: #9
Progress: 0%

• [P0] Implement a Go PR review bot able to run multiple static analysis tools, make it available to specific users and gather feedback
• [P1] Add “do not reinvent the wheel” feature to the bot based on gemini function duplication
• [P1] Make bot language independent, consider Docker + gRPC based infra

Define DevRel organization

Parent objective: #2
Progress: 0%

• [P0] Describe the metrics of devrel success
• [P0] Set monitoring up for all processes valuable to devrel
• [P1] Create a dashboard displaying those metrics
• [P0] Implement kanban processes in DevRel, follow the source{d} Engineering Methodology
• [P0] Set up biweekly sync-ups with Eiso, Marcelo, Maximo, and Fernanda

Collect native AST structures for supported drivers

Parent objective: #21
Progress: 6/6

• Go (bblfsh/go-driver#11)
• Java (bblfsh/java-driver#66)
• JavaScript (bblfsh/javascript-driver#15)
• PHP (bblfsh/php-driver#12)
• Python (bblfsh/python-driver#146)
• Ruby (bblfsh/ruby-driver#16)

Being a better company to work at

Parent objective: #1
Progress: 0%

• [P0] Successfully implement best practices for being a remote company #40
• [P0] Having a more diverse hiring funnel (increase diversity in terms of gender and race)
• [P0] Improve instrumentation of the clusters for all teams #59
• [P1] Successfully execute OKRs methodology
• [P1] Remove technical friction between multiple teams #19

Design the gitbase playground

Parent objective: #8
Progress: 0%

• [P0] Competitive Research
• [P0] Wireframing
• [P1] Usability Testing
• [P1] Working Prototype
• [P1] User Research Activities & Report

Enable sharing and publishing MLonCode models

Parent objective: #10
Progress: 0%

• [P0] Define and design the product for model sharing (relates to DevRel proposals)
• [P1] Conduct user research with all key users (e.g.: key academic groups, users of our stack).

Having a more diverse funnel in terms of gender and race

Parent objective: #4
Progress: 2/3

• [P1] Identify and solve 2 potential bottlenecks
• [P1] Developer community promotion via social media
• [P2] Getting in touch with existing communities (eg. women developer communities)

Successfully implement best practices for being a remote company

Parent objective: #4
Progress: 0%

• [P0] Create a study on employees sentiment

Deliver structured user research

Parent objective: #6
Progress: 0%

• [P0] Define and describe the key use case segments
• [P0] Map formally the personas for our products
• [P1] Conduct 15 user research interviews
• [P1] Conduct quantitative research over the Slack community

Optimize borges to keep up with all repository updates within 30 days

Parent objective: #15
Progress: 0/5

• [P0] improve downloading of new repos by 50%
• [P1] improve update rooted repositories by 50%
• [P1] increase job throghtput by 30%
• [P2] decrease timeout errors by 30%
• [P2] decrease pod restarts by 50%

Make engine queries on PGA stable

Parent objective: #17
Progress: 0/2

• [P0] Fix the reported errors and do not crash
• [P1] Report errors with meaning information for tracing the root causes

Stable pipeline with rovers and borges

Parent objective: #14
Progress: 0/3

• [P0] Retry on non-fatal failures with some delay (e.g. 1h for temporary, 1d for permanent)
• [P0] Improve debugging capabilities (e.g. recover from panics, develop the right tooling to retrieve logs for failed jobs)
• [P1] add different priorities to jobs
• [P2] update already fetched repositories depending on last commit date and fetched at date
• [P2] regression tests
• [P3] handle correctly repository deletion

Implement visual representation of UASTs

Parent objective: #12
Progress: 30%

• [P0] Implement a tool to convert AST files to SVG
• [P0] Change UAST text file format to YAML