I engineered features, tried different methods, and finetuned models. My best one is written about here.