Actor-Critic Implementation Considerations