Whisk together 2 cups whipping cream, milk, lemon pudding mixes, and lemon juice in a large bowl until creamy and smooth. Cover and refrigerate pudding in the fridge until set up, about 30-60 minutes.
In another bowl, beat the remaining 2 cups whipping cream in another bowl until foamy. Add the powdered sugar and vanilla until stiff peaks form.
Layer 1/2 of the angel food cake in a trifle bowl. Top with 1/2 of the pudding, 1/2 of the strawberries, and 1/2 of the blueberries. Spread 1/2 of the whipped cream over berries. Repeat layers. Cover and refrigerate until ready to serve.