A Bit More Bert