A building company and four men have been charged in connection with the death of a woman killed by falling bricks in 2018.