You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-21 - 18:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Thu May 21, 2026 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4009289995547,5cyclictest4030640-21kworker/u8:0+events_unbound08:20:211
4009298995041,6cyclictest4016639-21idleruntime-cro07:30:013
4009284994942,4cyclictest4110845-21sendmail12:00:000
4009293994740,4cyclictest4051833-21cat09:10:002
4009293994718,4cyclictest0-21swapper/210:15:002
4009298994638,4cyclictest4105745-21munin-plugin-st11:45:013
4009284994634,9cyclictest121ktimers/010:55:120
4009298994539,4cyclictest4039357-21kworker/u8:1+events_unbound10:10:373
4009298994538,4cyclictest4043076-21kthreadd08:45:013
4009298994436,5cyclictest4048399-21idleruntime-cro09:00:003
4009284994437,4cyclictest4053728-21munin-plugin-st09:15:010
4009284994436,4cyclictest4114263-21idleruntime-cro12:10:010
4009298994336,5cyclictest4062175-21kworker/u8:3+events_unbound09:50:363
4009284994335,5cyclictest4023881-21idleruntime-cro07:50:010
4009284994335,5cyclictest4023881-21idleruntime-cro07:50:010
4009284994335,5cyclictest4009131-21kworker/u8:2+events_unbound07:35:030
4009284994334,4cyclictest0-21swapper/009:20:000
4009298994234,4cyclictest0-21swapper/307:50:013
4009298994234,4cyclictest0-21swapper/307:50:013
400928999411,7cyclictest131rcu_preempt07:45:131
400928999411,7cyclictest131rcu_preempt07:45:131
4009298994033,4cyclictest0-21swapper/311:25:013
4009298994031,6cyclictest4084170-21unixbench_multi10:40:223
4009298994029,7cyclictest4062451-21sh09:40:013
4009293994032,5cyclictest4117662-21sendmail12:20:012
4009293994030,6cyclictest0-21swapper/211:55:552
400928499404,4cyclictest131rcu_preempt09:45:140
4009284994032,4cyclictest0-21swapper/011:45:010
4009284994029,8cyclictest4048404-21sendmail09:00:000
4009289993930,4cyclictest0-21swapper/108:40:001
4009289993830,4cyclictest0-21swapper/112:39:591
4009289993828,6cyclictest0-21swapper/111:00:001
4009289993827,8cyclictest4084167-21grep10:40:231
4009289993827,8cyclictest231ktimers/112:15:131
4009284993827,8cyclictest151rcuc/010:15:130
4009284993827,8cyclictest151rcuc/010:15:120
4009284993826,9cyclictest121ktimers/009:40:110
4009284993826,6cyclictest0-21swapper/011:30:230
400928499381,5cyclictest131rcu_preempt10:45:100
4009289993728,6cyclictest0-21swapper/109:15:001
4009284993730,4cyclictest4107440-21ls11:50:010
4009298993629,4cyclictest4055418-21cron09:20:013
4009298993628,5cyclictest4028923-21kworker/u8:1+events_unbound08:05:143
4009298993628,4cyclictest4053720-21sh09:15:013
4009298993627,5cyclictest4051350-21unixbench_multi09:05:263
4009298993626,6cyclictest0-21swapper/310:55:253
4009293993626,5cyclictest0-21swapper/207:15:012
4009289993629,4cyclictest4073924-21unixbench_multi10:10:231
4009289993628,4cyclictest0-21swapper/109:40:331
4009289993628,4cyclictest0-21swapper/108:30:221
4009289993626,6cyclictest0-21swapper/107:25:251
4009289993625,7cyclictest0-21swapper/111:40:251
4009298993525,7cyclictest391ktimers/310:30:133
4009298993516,5cyclictest4030640-21kworker/u8:0+events_unbound08:23:563
4009289993528,4cyclictest0-21swapper/109:15:271
4009289993526,6cyclictest0-21swapper/109:35:011
4009284993529,4cyclictest4070884-21kworker/u8:2+events_unbound10:30:410
4009298993424,5cyclictest4077408-21grep10:20:263
4009298993424,5cyclictest4077408-21grep10:20:263
4009293993427,4cyclictest0-21swapper/207:50:262
4009293993424,5cyclictest4122311-21grep12:30:242
4009289993425,6cyclictest0-21swapper/111:40:011
4009289993425,6cyclictest0-21swapper/108:15:001
4009289993424,6cyclictest0-21swapper/109:50:271
4009284993428,3cyclictest4060745-21apt-key09:35:020
4009284993427,3cyclictest0-21swapper/010:40:000
4009284993426,4cyclictest0-21swapper/010:40:220
4009298993323,7cyclictest4096981-21apt11:20:013
4009284993326,4cyclictest0-21swapper/009:35:260
4009298993226,4cyclictest4018275-21kworker/u8:3+events_unbound08:35:243
4009298993225,4cyclictest4018595-21latency_hist07:35:013
4009298993224,4cyclictest0-21swapper/312:25:143
4009298993223,4cyclictest0-21swapper/312:20:223
4009298993213,5cyclictest4091685-21kworker/u8:0+events_unbound11:45:293
4009293993224,4cyclictest4082446-21unixbench_multi10:35:262
4009293993224,4cyclictest0-21swapper/209:35:252
4009289993222,7cyclictest4110351-21grep11:55:251
4009289993222,6cyclictest0-21swapper/108:50:261
400928499322,4cyclictest131rcu_preempt12:30:130
4009284993224,4cyclictest0-21swapper/007:35:010
4009284993223,5cyclictest4032152-21grep08:10:250
4009298993122,5cyclictest4076103-21grep10:20:013
4009298993122,5cyclictest4076103-21grep10:20:003
4009293993123,4cyclictest0-21swapper/210:25:242
4009293993123,4cyclictest0-21swapper/208:10:152
4009289993123,5cyclictest4014934-21cron07:25:001
4009289993122,4cyclictest0-21swapper/107:50:151
4009284993114,9cyclictest4084338-21kworker/u8:1+events_unbound11:08:080
4009284993114,9cyclictest4084338-21kworker/u8:1+events_unbound11:08:080
400928499311,3cyclictest131rcu_preempt08:05:130
4009284993113,13cyclictest121ktimers/011:15:120
4009298993022,4cyclictest4044846-21cat08:50:013
4009298993022,4cyclictest0-21swapper/309:55:233
4009293993023,4cyclictest4027494-21kthreadd08:00:012
4009293993022,5cyclictest4020248-21kthreadd07:40:012
4009293993022,4cyclictest0-21swapper/209:10:262
4009293993020,7cyclictest4087623-21unixbench_singl10:50:252
4009289993021,6cyclictest4088117-21sort10:55:011
400928999301,5cyclictest131rcu_preempt11:20:121
4009284993024,3cyclictest13550irq/42-30be0000.ethernet08:50:040
4009284993023,3cyclictest0-21swapper/010:50:260
4009284993022,5cyclictest4114240-21kworker/u8:3+events_unbound12:21:050
4009284993021,5cyclictest0-21swapper/008:15:290
4009284993020,7cyclictest0-21swapper/012:20:000
4009298992923,3cyclictest0-21swapper/307:15:273
4009298992922,5cyclictest4087907-21kworker/u8:3+events_unbound11:00:593
4009298992919,7cyclictest0-21swapper/312:05:003
4009293992922,4cyclictest4102317-21cron11:35:012
4009293992922,4cyclictest0-21swapper/209:15:272
4009293992921,4cyclictest0-21swapper/207:40:252
4009289992920,6cyclictest0-21swapper/112:10:011
4009289992920,6cyclictest0-21swapper/111:25:261
4009289992920,6cyclictest0-21swapper/110:25:251
4009289992920,6cyclictest0-21swapper/107:30:161
4009289992920,4cyclictest0-21swapper/107:10:151
4009289992919,6cyclictest0-21swapper/109:20:261
4009289992918,5cyclictest4062175-21kworker/u8:3+events_unbound09:47:221
4009289992913,4cyclictest131rcu_preempt08:49:051
4009284992921,5cyclictest0-21swapper/009:30:000
4009284992921,4cyclictest0-21swapper/009:20:250
4009284992920,6cyclictest4011192-21cat07:15:010
4009284992920,6cyclictest0-21swapper/010:00:000
4009284992911,12cyclictest4089579-21kworker/u8:4+events_unbound11:13:120
4009284992911,12cyclictest4089579-21kworker/u8:4+events_unbound11:13:120
4009298992820,5cyclictest4100982-21grep11:30:133
4009293992822,3cyclictest0-21swapper/209:50:182
4009293992820,5cyclictest4119365-21cron12:25:002
4009293992820,4cyclictest0-21swapper/211:50:242
4009293992820,4cyclictest0-21swapper/207:30:012
4009293992819,6cyclictest4076493-21fschecks_count10:20:182
4009293992819,6cyclictest4076493-21fschecks_count10:20:172
4009289992821,4cyclictest0-21swapper/108:40:251
4009289992820,5cyclictest0-21swapper/108:30:001
4009289992820,4cyclictest0-21swapper/109:00:251
4009289992819,6cyclictest0-21swapper/110:10:011
4009289992818,6cyclictest0-21swapper/107:45:011
4009284992823,3cyclictest13550irq/42-30be0000.ethernet10:25:140
4009284992822,3cyclictest4022166-21latency_hist07:45:010
4009284992821,5cyclictest3994846-21kworker/u8:0+events_unbound07:15:030
4009284992820,6cyclictest4039357-21kworker/u8:1+events_unbound09:05:320
4009284992820,4cyclictest0-21swapper/008:00:250
4009284992819,6cyclictest4121079-21munin-run12:29:590
4009284992810,15cyclictest4015194-21cpu07:25:130
4009298992720,5cyclictest4091685-21kworker/u8:0+events_unbound11:25:493
4009298992720,3cyclictest0-21swapper/309:45:273
4009298992719,6cyclictest4077597-21kworker/u8:3+events_unbound10:25:123
4009298992719,4cyclictest0-21swapper/311:50:243
4009298992717,6cyclictest0-21swapper/308:15:293
4009293992720,4cyclictest0-21swapper/208:55:152
4009293992720,4cyclictest0-21swapper/208:50:262
4009293992719,4cyclictest0-21swapper/208:20:212
4009293992717,6cyclictest0-21swapper/208:40:002
4009289992719,4cyclictest0-21swapper/108:05:251
4009289992718,6cyclictest0-21swapper/109:55:151
4009289992717,7cyclictest4092899-21grep11:05:251
4009289992717,7cyclictest4092899-21grep11:05:251
4009289992715,8cyclictest1-21systemd10:45:421
4009284992719,6cyclictest4096875-21kworker/u8:2+events_unbound11:20:170
4009284992719,5cyclictest0-21swapper/011:30:000
4009284992719,4cyclictest0-21swapper/007:55:260
4009284992715,7cyclictest0-21swapper/009:05:010
4009298992620,4cyclictest4030640-21kworker/u8:0+events_unbound08:10:163
4009298992620,3cyclictest0-21swapper/312:15:173
4009298992619,5cyclictest4070884-21kworker/u8:2+events_unbound10:50:453
4009298992619,4cyclictest4021957-21cron07:45:003
4009298992618,5cyclictest0-21swapper/307:25:013
4009298992618,4cyclictest0-21swapper/312:05:153
4009298992617,6cyclictest0-21swapper/309:35:013
4009298992617,5cyclictest0-21swapper/311:10:253
4009298992617,5cyclictest0-21swapper/311:10:243
4009298992616,6cyclictest4122353-21head12:30:263
4009298992614,8cyclictest4115480-21grep12:10:263
4009293992619,3cyclictest0-21swapper/210:20:012
4009293992619,3cyclictest0-21swapper/210:20:012
4009293992617,6cyclictest4043690-21sort08:45:202
4009293992617,5cyclictest4124058-21head12:35:242
4009293992617,5cyclictest0-21swapper/207:20:012
4009289992620,3cyclictest0-21swapper/111:45:241
4009289992619,5cyclictest4042936-21kworker/u8:0+events_unbound08:56:541
4009289992619,4cyclictest0-21swapper/108:15:181
4009289992618,5cyclictest0-21swapper/112:20:261
400928499268,6cyclictest11-21ksoftirqd/008:35:260
400928499267,11cyclictest11-21ksoftirqd/009:50:150
4009284992619,4cyclictest121ktimers/008:30:170
4009284992613,4cyclictest131rcu_preempt10:23:130
4009284992613,4cyclictest131rcu_preempt10:23:120
4009284992611,9cyclictest131rcu_preempt11:54:360
4009284992610,6cyclictest11-21ksoftirqd/012:35:210
4009298992519,4cyclictest4042936-21kworker/u8:0+events_unbound09:04:593
4009298992519,4cyclictest3994846-21kworker/u8:0+events_unbound07:56:463
4009298992519,3cyclictest4109916-21ntpq11:55:193
4009298992518,4cyclictest4025344-21grep07:50:263
4009298992518,4cyclictest0-21swapper/309:40:153
4009298992517,6cyclictest4082407-21sed10:35:253
4009298992517,5cyclictest4037949-21sh08:29:593
4009298992517,5cyclictest4020237-21cron07:40:003
4009298992517,5cyclictest0-21swapper/310:00:273
4009298992515,7cyclictest4045779-21ntp_states08:50:213
4009293992519,3cyclictest0-21swapper/210:45:192
4009293992517,4cyclictest0-21swapper/210:05:272
4009293992515,7cyclictest4114666-21grep12:10:152
4009289992518,4cyclictest0-21swapper/109:10:001
4009289992515,7cyclictest4091236-21grep11:00:241
400928499257,6cyclictest11-21ksoftirqd/008:40:140
4009284992521,2cyclictest13550irq/42-30be0000.ethernet10:00:140
4009284992518,5cyclictest4103840-21kworker/u8:2+events_unbound12:00:560
4009284992518,3cyclictest0-21swapper/011:40:010
4009284992517,5cyclictest0-21swapper/008:50:000
4009293992418,3cyclictest0-21swapper/209:00:192
4009293992416,6cyclictest4062175-21kworker/u8:3+events_unbound10:01:172
4009293992416,4cyclictest0-21swapper/210:55:192
4009293992416,3cyclictest0-21swapper/208:05:162
4009293992414,7cyclictest204-21dbus-daemon09:40:342
4009293992414,6cyclictest4069264-21cron10:00:012
4009293992411,7cyclictest0-21swapper/212:00:242
4009289992417,4cyclictest0-21swapper/111:30:241
4009289992416,5cyclictest0-21swapper/110:30:261
4009289992416,5cyclictest0-21swapper/109:25:241
4009289992414,7cyclictest4062311-21seq09:38:171
4009289992413,8cyclictest4013023-21seq07:17:441
400928499249,8cyclictest131rcu_preempt08:25:210
4009284992417,5cyclictest4087907-21kworker/u8:3+events_unbound11:00:560
4009284992415,6cyclictest4035334-21ntpq08:20:190
4009284992414,7cyclictest0-21swapper/007:50:200
400928499241,3cyclictest131rcu_preempt12:10:130
400928499241,21cyclictest0-21swapper/010:10:260
4009298992317,4cyclictest4084338-21kworker/u8:1+events_unbound11:36:053
4009298992317,4cyclictest4039357-21kworker/u8:1+events_unbound10:05:243
4009298992317,4cyclictest4018275-21kworker/u8:3+events_unbound08:33:113
4009298992317,3cyclictest0-21swapper/310:45:173
4009298992316,5cyclictest3994846-21kworker/u8:0+events_unbound08:00:083
4009298992315,4cyclictest0-21swapper/311:05:433
4009298992315,4cyclictest0-21swapper/311:05:433
400929899231,11cyclictest0-21swapper/309:27:003
4009293992317,4cyclictest311ktimers/211:15:232
4009293992315,4cyclictest0-21swapper/211:05:152
4009293992315,4cyclictest0-21swapper/211:05:152
4009289992317,3cyclictest0-21swapper/112:10:201
4009289992317,3cyclictest0-21swapper/110:15:161
4009289992317,3cyclictest0-21swapper/110:15:161
4009289992317,3cyclictest0-21swapper/107:55:241
4009289992313,7cyclictest4108137-21cat11:50:171
400929899223,5cyclictest131rcu_preempt07:10:123
4009298992213,6cyclictest0-21swapper/309:20:233
4009298992212,7cyclictest4124083-21users12:35:263
4009293992216,3cyclictest0-21swapper/207:20:212
4009293992215,4cyclictest4095061-21sh11:14:592
4009293992215,4cyclictest4095061-21sh11:14:592
4009293992215,4cyclictest0-21swapper/211:00:252
4009293992214,5cyclictest0-21swapper/210:45:012
4009293992211,8cyclictest4100489-21sed11:30:012
400928999227,4cyclictest131rcu_preempt07:35:291
4009289992214,5cyclictest0-21swapper/112:00:151
4009289992214,5cyclictest0-21swapper/111:15:201
4009289992212,7cyclictest4082144-21expr10:35:221
400928999221,14cyclictest4120802-21taskset12:26:471
4009284992216,4cyclictest4004033-21kworker/u8:1+events_unbound07:21:050
4009284992213,6cyclictest4071650-21cat10:05:210
400929399219,8cyclictest4105264-21grep11:40:242
4009293992115,3cyclictest0-21swapper/209:45:222
4009293992114,5cyclictest178-21systemd-udevd09:24:412
4009293992114,4cyclictest4104015-21latency_hist11:40:002
4009293992114,4cyclictest4060579-21latency_hist09:35:002
4009293992114,4cyclictest4018342-21latency_hist07:35:022
4009289992115,3cyclictest0-21swapper/112:30:161
4009293992014,3cyclictest0-21swapper/208:25:192
4009293992013,4cyclictest0-21swapper/211:25:012
4009293992011,6cyclictest4027902-21cut08:00:152
400929399201,13cyclictest4023897-21awk07:50:002
400929399201,13cyclictest4023897-21awk07:50:002
4009289992013,5cyclictest4042936-21kworker/u8:0+events_unbound10:20:591
4009289992013,5cyclictest4042936-21kworker/u8:0+events_unbound10:20:591
4009289992013,5cyclictest231ktimers/110:00:151
4009293991913,3cyclictest0-21swapper/208:30:202
4009293991912,5cyclictest311ktimers/210:34:592
4009293991911,5cyclictest0-21swapper/209:25:232
4009293991812,4cyclictest311ktimers/212:25:202
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional