ability to define taints for node pool

[ddevadat]

Community Note

• Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
• Please do not leave "+1" or "me too" comments, they generate extra noise for issue followers and do not help prioritize the request
• If you are interested in working on this issue or have submitted a pull request, please leave a comment

Description

This is a common customer request to define taints for the worker node pool. Currently there is no intuitive way to do this. We can ofcourse create a customized cloud init script, but suggesting a more user friendly way to do this.

New or Affected Resource(s)

Potential Terraform Configuration

# Copy-paste any Terraform configurations for how the requested feature may be used. 

  worker_pools = {
    workload = {
      mode   = "node-pool",
      size   = 3
      shape  = local.worker_shape,
      create = true
    },
    rook = {
      mode   = "node-pool",
      size   = 3,
      shape  = local.worker_shape,
      os_version = 8
      create = true
      node_labels = {
        "storage" = "rook",
        "oke.oraclecloud.com/pool.name" = "rook"
      },
      taints = {
       storage=rook:NoSchedule
      "oke.oraclecloud.com/pool.name" = "rook:NoSchedule"
      }

}

References

[hyder]

does the oke api support taint?

[ddevadat]

There is no api support which can apply taint unlike labels for managed node pool. We have to pass it in the cloud init script as a kubelet argument. The idea is to simplify it from a users point of view.

api support for taint is avaiable for virtual node pool

[ddevadat]

This is my initial approach ...define the workerpool variable like below

worker_pool = {
  workload = {
    create           = true
    mode             = "node-pool"
    os_version       = 8
    size             = 1
    shape            = "VM.Standard.E3.Flex"
    ocpus            = 1
    memory           = 16
    boot_volume_size = 50
    node_labels = {
      "project" = "workload"
      "oke.oraclecloud.com/pool.name" = "workload"
    }
    kubelet_extra_args = "--register-with-taints=project=workload:NoSchedule"
  }
  monitoring = {
    create           = true
    mode             = "node-pool"
    os_version       = 8
    size             = 1
    shape            = "VM.Standard.E4.Flex"
    ocpus            = 1
    memory           = 16
    boot_volume_size = 50
    node_labels = {
      "project" = "monitoring"
      "oke.oraclecloud.com/pool.name" = "monitoring"
    }
  }
}

This should create two node pool named workload and monitoring.
np workload will have the taint project=workload:NoSchedule , whereas np monitoring will not be having any taint.

This way we can not only support taint, but any other upstream kubelet supported extra args