Scalability and Flexibility in network optimization