Projects

Using Machine Learning to Accelerate Global Optimization

This project explores the use of ML to predict optimal instance-specific heuristic parameters within global optimization algorithms without sacrificing global optimality guarantees. We have devised algorithms to optimally partition variable domains for piecewise convex relaxation of nonconvex problems. Our ML algorithms are able to accelerate the solution of challenging problems by up to three orders of magnitude for specific instances and families of nonconvex problems by an order of magnitude on average!

This project explores the use of ML to predict optimal instance-specific heuristic parameters within global optimization algorithms without sacrificing global optimality guarantees. We have devised algorithms to optimally partition variable domains for piecewise convex relaxation of nonconvex problems. Our ML algorithms are able to accelerate the solution of challenging problems by up to three orders of magnitude for specific instances and families of nonconvex problems by an order of magnitude on average!

Enhancing the Resilience of the Power Grid to Extreme Weather Events

This project aims to leverage ensemble forecasts of extreme weather events (such as hurricanes and winter storms) to make proactive grid operation decisions and mitigate power outages. We model the operational resilience of the grid using multistage stochastic programming and use stochastic dual dynamic programming to joinly optimize anticipative and restorative actions. Our preliminary results show that using hurricane forecasts to make proactive decisions can reduce load shed by up to 5% on average!

This project aims to leverage ensemble forecasts of extreme weather events (such as hurricanes and winter storms) to make proactive grid operation decisions and mitigate power outages. We model the operational resilience of the grid using multistage stochastic programming and use stochastic dual dynamic programming to joinly optimize anticipative and restorative actions. Our preliminary results show that using hurricane forecasts to make proactive decisions can reduce load shed by up to 5% on average!

Integrating Machine Learning Predictions Within Stochastic Optimization

Uncertain parameters in optimization models can often be predicted using covariate information. For instance, product demands can be estimated using seasonality, historical data, and web search results for use in a supply chain model. We investigate a flexible framework for data-driven decision-making under uncertainty that integrates an ML prediction model and its residuals within a sample average approximation, and identify conditions for convergence as the sample size increases. Our numerical experiments demonstrate the advantages of our data-driven formulations in the limited data regime.

Uncertain parameters in optimization models can often be predicted using covariate information. For instance, product demands can be estimated using seasonality, historical data, and web search results for use in a supply chain model. We investigate a flexible framework for data-driven decision-making under uncertainty that integrates an ML prediction model and its residuals within a sample average approximation, and identify conditions for convergence as the sample size increases. Our numerical experiments demonstrate the advantages of our data-driven formulations in the limited data regime.

Algorithms for Nonconvex Stochastic Programming

Two-stage stochastic mixed-integer nonlinear programs (MINLPs) are widely used for optimization under uncertainty in areas like energy, finance, and supply chain management. These models are difficult to solve due to nonconvex constraints and discrete decision variables. We design a decomposition algorithm and a software for two-stage stochastic MINLPs. In collaboration with NTNU, we have used it to design a hybrid waste tire and natural gas polygeneration system, achieving a 100% increase in expected net present value over a nominal design.

Two-stage stochastic mixed-integer nonlinear programs (MINLPs) are widely used for optimization under uncertainty in areas like energy, finance, and supply chain management. These models are difficult to solve due to nonconvex constraints and discrete decision variables. We design a decomposition algorithm and a software for two-stage stochastic MINLPs. In collaboration with NTNU, we have used it to design a hybrid waste tire and natural gas polygeneration system, achieving a 100% increase in expected net present value over a nominal design.

Convergence Rate of Branch-and-Bound Algorithms

Analysis of the cluster problem in global optimization for (a) an unconstrained problem, (b) an inequality-constrained problem, and (c) an equality-constrained problem.

Branch-and-bound (B&B) algorithms are the primary framework for solving nonconvex problems to global optimality. However, a major drawback is that they can require an exponential number of iterations relative to the search space dimension to converge. Reduced-space B&B algorithms attempt to address this by branching on a lower-dimensional subspace, but their convergence rate remains poorly understood. We analyze the convergence rate of B&B algorithms and find that reduced-space methods may be impractical without the use of auxiliary domain reduction techniques to speed up convergence.

Branch-and-bound (B&B) algorithms are the primary framework for solving nonconvex problems to global optimality. However, a major drawback is that they can require an exponential number of iterations relative to the search space dimension to converge. Reduced-space B&B algorithms attempt to address this by branching on a lower-dimensional subspace, but their convergence rate remains poorly understood. We analyze the convergence rate of B&B algorithms and find that reduced-space methods may be impractical without the use of auxiliary domain reduction techniques to speed up convergence.

Papers

Underlined Authors are Graduate Students

Working Papers

  1. E. George, R. Kannan, H. Nagarajan, and D. Deka.
    Learning to Accelerate the Global Optimization of QCQPs: An End-to-End Graph-Based Stochastic Partitioning Approach.
  2. M. Goutham, R. Kannan, D. Deka, H. Nagarajan, and R. Bent.
    Operational Resilience Enhancement of Electric Grids using Uncertain Hurricane Forecasts.
  3. R. Kannan, N. Ho-Nguyen, and J. R. Luedtke.
    Data-Driven Multistage Stochastic Optimization on Time Series.
    [Slides]
  4. R. Kannan and P. I. Barton.
    GOSSIP: Decomposition Software for the Global Optimization of Nonconvex Two-Stage Stochastic Mixed-Integer Nonlinear Programs.
    [Slides]
  5. R. Kannan and P. I. Barton.
    Integrating Benders Decomposition and Lagrangian Relaxation for Solving Two-Stage Stochastic Mixed-Integer Nonlinear Programs.

Journal Papers Under Review

  1. E. M. Turan, J. Jäschke, and R. Kannan (2023).
    Bounding-Focused Discretization Methods for the Global Optimization of Nonconvex Semi-Infinite Programs.
    [Preprint] [Slides]
  2. R. Kannan, D. Deka, and H. Nagarajan (2022).
    Strong Partitioning and a Machine Learning Approximation for Accelerating the Global Optimization of Nonconvex QCQPs.
    [Preprint] [Slides]
  3. R. Kannan, G. Bayraksan, and J. R. Luedtke (2020).
    Data-Driven Sample Average Approximation With Covariate Information.
    [Preprint] [Slides] [Poster] [Code]

Peer-Reviewed Journal Papers

  1. R. Kannan, G. Bayraksan, and J. R. Luedtke (2024).
    Residuals-based distributionally robust optimization with covariate information, Mathematical Programming (Series A), 207(1–2), pp. 369-425.
    [Journal] [Preprint] [Slides] [Code]
  2. A. Subramanian, R. Kannan, F. Holtorf, T. Adams, T. Gundersen, and P. I. Barton (2023).
    Optimization under uncertainty of a hybrid waste tire and natural gas feedstock flexible polygeneration system using a decomposition algorithm, Energy, 284, 129222, pp. 1-11. [Journal] [Preprint]
  3. R. Kannan and J. R. Luedtke (2021).
    A stochastic approximation method for approximating the efficient frontier of chance-constrained nonlinear programs, Mathematical Programming Computation, 13, 705–751.
    [Journal] [Preprint] [Slides] [Poster] [Code]
  4. R. Kannan, J. R. Luedtke, and L. A. Roald (2020).
    Stochastic DC optimal power flow with reserve saturation, Electric Power Systems Research (special issue for the XXI Power Systems Computation Conference), pp. 1-9.
    [Journal] [Preprint] [Slides] [Code]
  5. R. Kannan and P. I. Barton (2018).
    Convergence-order analysis of branch-and-bound algorithms for constrained problems, Journal of Global Optimization, 71(4), pp. 753-813.
    [Journal] [PDF] [Slides]
  6. R. Kannan and P. I. Barton (2017).
    The cluster problem in constrained global optimization, Journal of Global Optimization, 69(3), pp. 629-676.
    [Journal] [PDF] [Slides]
  7. R. Kannan and A. K. Tangirala (2014).
    Correntropy-based partial directed coherence for testing multivariate Granger causality in nonlinear processes, Physical Review E, 89(6), 062144, pp. 1-15.
    [Journal] [PDF]

Peer-Reviewed Conference Papers

  1. E. M. Turan, R. Kannan, and J. Jäschke (2022).
    Design of PID controllers using semi-infinite programming, Proceedings of the 14th International Symposium on Process Systems Engineering, pp. 439-444.
    [Conference] [Preprint]
  2. R. Kannan and P. I. Barton (2016).
    The cluster problem in constrained global optimization, Proceedings of the XIII Global Optimization Workshop (GOW’16), pp. 9-12.
    [Conference]

Technical Reports

  1. R. Kannan, G. Bayraksan, and J. R. Luedtke.
    Heteroscedasticity-aware residuals-based contextual stochastic optimization, pp. 1-15.
    [Preprint]

Theses

  1. Ph.D. (2018): Algorithms, analysis and software for the global optimization of two-stage stochastic programs, MIT.
    [DSpace@MIT] [PDF]
  2. B.Tech. (2012): Partial directed coherence for nonlinear Granger causality: A generalized correlation function-based approach, IIT Madras.

Selected Talks

Plenary

  • A Stochastic Approximation Method for Approximating the Efficient Frontier of Chance-Constrained Nonlinear Programs [Slides]
    CAST Division Plenary, AIChE Annual Meeting, Nov. 2021.
  • GOSSIP: Decomposition Software for the Global Optimization of Nonconvex Two-Stage Stochastic Mixed-Integer Nonlinear Programs [Updated Slides]
    CAST Division Plenary, AIChE Annual Meeting, Nov. 2016.

Invited

  • Learning to Accelerate the Global Optimization of QCQPs
    International Symposium on Mathematical Programming (ISMP), July 2024.
  • Bounding-Focused Discretization Methods for the Global Optimization of Nonconvex SIPs
    INFORMS Optimization Society Conference, March 2024.
  • LE2GO: Learning An End-to-End Partitioning Policy for the Global Optimization Of QCQPs
    INFORMS Annual Meeting, Oct. 2023.
  • Data-Driven Multistage Stochastic Optimization on Time Series
    International Conference on Stochastic Programming (ICSP), July 2023.
  • Data-Driven Multistage Stochastic Optimization on Time Series
    International Conference on Continuous Optimization (ICCOPT), July 2022.
  • Residuals-Based Distributionally Robust Optimization with Covariate Information
    INFORMS Annual Meeting, Oct. 2021.
  • Data-Driven Sample Average Approximation with Covariate Information [Slides]
    INFORMS Annual Meeting, Nov. 2020.
  • Stochastic DC Optimal Power Flow With Reserve Saturation [Slides]
    INFORMS Annual Meeting, Nov. 2020.
  • Convergence-Order Analysis of Lower Bounding Schemes for Constrained Global Optimization Problems [Slides]
    International Conference on Continuous Optimization (ICCOPT), Aug. 2016.

Contributed

  • Learning to Accelerate the Global Optimization of QCQPs [Slides]
    AIChE Annual Meeting, Nov. 2022.
  • Residuals-Based DRO with Covariate Information [Slides]
    Robust Optimization Webinar, April 2021.
  • The Cluster Problem in Constrained Global Optimization
    Global Optimization Workshop, Aug. 2016.