CodeTransformer

CodeTransformer is a code search engine that uses Deep Learning to answer natural language queries.

This repo contains the code of the CodeTransformer as well as the results required to reproduce the findings of the paper:

Evangelos Papathomas, Themistoklis Diamantopoulos, Andreas Symeonidis,
Semantic Code Search in Software Repositories using Neural Machine Translation

Preprocessing

To preprocess the dataset, run the following command.

python preprocess.py

Training

To train the model, run the following command.

python train.py

Evaluation

To evaluate the model, run the following command.

python evaluate.py

CodeTransformer was evaluated using the 99 evaluation queries suggested by CodeSearchNet and the 40 most popular Java-related questions on Stack Overflow. The recommended code snippets for the CodeSearchNet evaluation queries were obtained through evaluation.py, while the recommended code snippets for the Stack Oveflow questions were obtained manually through CodeTransformers web application. The results for both datasets are available in the results folder.

Libraries and APIs listed in /app/requirements.txt required.