Searcharxiv⌕ Search

arXiv subjects

Marco Montes de Oca

Publications and source records attributed to Marco Montes de Oca.

2 recordsLinked to original sources

Joint Optimization of Human Headcount and Stochastic AI Resource Capacity

Generative AI tools are rapidly becoming standard for coding and other business operations. However, while these tools can drive productivity, their unpredictable, and often significant, costs are putting severe financial strain on organizations. The leadership of such organizations must split a fixed budget between human headcount and generative-AI token capacity, yet standard deterministic planning ignores both the heavy-tailed volatility of token consumption and the cognitive cost of auditing AI-generated output. We model the joint allocation by intersecting a cognitive-friction-adjusted production function with a chance-constrained stochastic budget frontier. Per-engineer token usage is treated as i.i.d., non-negative, and right-skewed; no parametric family is assumed, as only its mean, variance, and skewness enter the analysis. The chance constraint is reduced to a deterministic equivalent via the Central Limit Theorem with a Cornish--Fisher skewness correction. Solving the resulting Lagrangian yields a closed-form optimal headcount, a transcendental condition for optimal per-capita token intensity, and a bordered-Hessian second-order condition that holds for any reasonable volatility-to-headcount ratio. Comparative statics show that rising individual token volatility raises optimal per-capita token intensity while contracting headcount: although human labor and tokens are complements in production, the stochastic budget makes them substitutes at the margin. Individual usage skewness acts as a pure deadweight tax that shrinks the budget without altering the substitution dynamics. Both conclusions presuppose that usage dispersion is invariant to the planned mean allocation. In the case where dispersion instead scales proportionally with the mean, the substitution reverses, so which regime applies is a sharp, empirically testable question.

cs.SE↗

Global Optimization of Data Pipelines in Heterogeneous Cloud Environments

Modern production data processing and machine learning pipelines on the cloud are critical components for many cloud-based companies. These pipelines are typically composed of complex workflows represented by directed acyclic graphs (DAGs). Cloud environments are attractive to these workflows due to the wide range of choice with heterogeneous instances and prices that can provide the flexibility for different cost-performance needs. However, this flexibility also leads to the complexity of selecting the right resource configuration (e.g., instance type, resource demands) for each task in the DAG, while simultaneously scheduling the tasks with the selected resources to reach the optimal end-to-end performance and cost. These two decisions are often codependent resulting in an NP-hard scheduling optimization bottleneck. Existing solutions only focus solely on either problem and ignore the co-effect on the end-to-end optimum. We propose AGORA, a scheduler that considers both task-level resource allocation and execution for DAG workflows as a whole in heterogeneous cloud environments. AGORA first (1) studies the characteristics of the tasks from prior runs and gives predictions on resource configurations, and (2) automatically finds the best configuration with its corresponding schedules for the entire workflow with a cost-performance objective. We evaluate AGORA in a heterogeneous Amazon Web Services (AWS) cloud environment with multi-tenant workflows served by Airflow and demonstrate a performance improvement up to 45% and cost reduction up to 77% compared to state-of-the-art schedulers. In addition, we apply AGORA to a real-world production trace from Alibaba and show cost reduction of 65% and DAG completion time reduction of 57%.

cs.DC↗