You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-30 - 17:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Mon Mar 30, 2026 12:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
347345421850,3sleep375-21kworker/3:1+events12:11:353
31727052600,2sleep2371rcuc/207:11:322
32838622590,2sleep3481ktimers/309:01:333
32331342580,2sleep1281rcuc/108:11:271
3171347994937,9cyclictest280-21systemd-journal09:30:010
3171355994742,3cyclictest3359572-21kworker/u8:0+events_unbound11:51:332
32218942450,6sleep20-21swapper/207:56:392
3171352994535,8cyclictest3385613-21ntpq10:41:381
3171352994435,6cyclictest280-21systemd-journal08:45:331
316651024428,10sleep10-21swapper/107:05:021
316651024428,10sleep10-21swapper/107:05:021
3171355994238,3cyclictest3267190-21kworker/u8:1+events_unbound10:51:352
3171355994238,3cyclictest3267190-21kworker/u8:1+events_unbound10:51:352
3171347994235,5cyclictest3178380-21kworker/u8:1+flush-8:007:56:290
3171347994235,5cyclictest280-21systemd-journal08:01:210
3171347994233,6cyclictest3207848-21latency_hist07:45:010
3171355994136,4cyclictest3161183-21kworker/u8:3+events_unbound07:31:422
3171355994132,7cyclictest280-21systemd-journal12:02:342
3171352994135,4cyclictest3386192-21kworker/u8:2+flush-8:011:06:341
3171352994132,7cyclictest280-21systemd-journal10:21:331
3171355994035,4cyclictest3213513-21kworker/u8:2+events_unbound09:06:362
3171347994035,4cyclictest3213513-21kworker/u8:2+events_unbound08:15:010
3171355993935,3cyclictest3248105-21kworker/u8:3+flush-8:008:26:442
3171352993928,8cyclictest3406202-21apt-get11:05:011
316765323927,7sleep30-21swapper/307:06:323
316765323927,7sleep30-21swapper/307:06:323
3171352993832,4cyclictest3283919-21journal-offline09:01:331
3171352993830,5cyclictest280-21systemd-journal07:12:301
3171352993828,8cyclictest3296320-21ntpq09:11:381
3171347993831,5cyclictest280-21systemd-journal11:01:530
3171355993733,3cyclictest3213513-21kworker/u8:2+events_unbound07:51:312
3171355993733,3cyclictest3178380-21kworker/u8:1+events_unbound07:16:312
3171352993728,6cyclictest3217739-21latency_hist07:55:011
3171352993527,6cyclictest280-21systemd-journal11:49:331
3171347993530,3cyclictest3389839-21kthreadcore10:46:330
3171347993530,3cyclictest3326810-21idleruntime-cro09:45:000
317134799351,31cyclictest1-21systemd10:35:000
32525472340,4sleep10-21swapper/108:30:011
3171347993423,8cyclictest3188642-21diskstats07:26:290
3171347993327,5cyclictest3267190-21kworker/u8:1+flush-8:010:11:420
3171347993327,4cyclictest3256436-21kworker/u8:0+events_unbound09:00:000
3171347993327,4cyclictest3248105-21kworker/u8:3+events_unbound08:36:340
3171347993325,5cyclictest3440702-21grep11:36:420
3171352993228,3cyclictest3391368-21idleruntime-cro10:50:001
3171352993226,4cyclictest3471050-21apt-get12:11:251
3171347993227,3cyclictest3292118-21cron09:10:000
3171347993222,8cyclictest3267440-21latency_hist08:45:010
3171347993222,8cyclictest3193576-21diskstats07:31:260
3171347993219,10cyclictest280-21systemd-journal08:46:330
3171355993127,3cyclictest3256436-21kworker/u8:0+events_unbound08:31:382
3171355993123,5cyclictest280-21systemd-journal10:25:002
3171347993127,2cyclictest3294673-21kthreadcore09:11:330
3171347993121,7cyclictest3341637-21latency_hist10:00:010
3171355993026,3cyclictest3213513-21kworker/u8:2+events_unbound09:01:362
3171352993026,2cyclictest3322910-21irqrtprio09:41:311
3171347993026,2cyclictest3485608-21apt-key12:25:000
3171347993025,3cyclictest3171186-21kworker/u8:0+events_unbound07:15:000
3171347993019,8cyclictest280-21systemd-journal08:20:000
33578372290,6sleep2371rcuc/210:16:332
3171355992926,2cyclictest3238124-21cut08:16:292
3171355992925,3cyclictest3321564-21kworker/u8:2+flush-8:009:46:432
3171355992925,2cyclictest3485136-21unixbench_multi12:21:442
3171352992925,2cyclictest3413880-21kthreadcore11:11:341
3171352992925,2cyclictest3327180-21aten2_r5power_c09:46:251
3171352992924,2cyclictest0-21swapper/107:21:291
3171352992922,5cyclictest3307364-21apt-get09:26:241
3171352992920,7cyclictest3252679-21apt-get08:31:221
3171347992924,4cyclictest3213513-21kworker/u8:2+flush-8:009:01:290
3171347992923,4cyclictest3436032-21kworker/u8:2+flush-8:012:11:380
3171347992921,6cyclictest3213115-21/usr/sbin/munin07:51:360
3171355992824,2cyclictest0-21swapper/211:00:002
3171352992824,2cyclictest3289704-21kthreadcore09:06:331
3171352992822,4cyclictest3178380-21kworker/u8:1+flush-8:007:56:381
3171352992822,4cyclictest3161183-21kworker/u8:3+flush-8:007:36:411
3171352992821,5cyclictest280-21systemd-journal11:34:331
3171352992820,6cyclictest280-21systemd-journal08:57:341
3171347992823,4cyclictest3213513-21kworker/u8:2+flush-8:008:51:290
3171347992822,4cyclictest3178380-21kworker/u8:1+flush-8:008:06:280
3171355992723,2cyclictest3387012-21cpuspeed_turbos10:46:262
3171352992724,2cyclictest401-21dbus-daemon12:10:001
3171352992724,2cyclictest3376294-21idleruntime-cro10:35:001
3171352992722,3cyclictest3455086-21kworker/u8:1+events_unbound12:31:341
3171352992721,4cyclictest280-21systemd-journal08:35:341
3171352992719,6cyclictest3277302-21latency_hist08:55:001
3171352992719,5cyclictest3183079-21latency_hist07:20:001
3171352992718,7cyclictest280-21systemd-journal12:18:331
3171352992718,7cyclictest280-21systemd-journal10:15:001
3171347992721,4cyclictest3211888-21needreboot07:46:360
3171347992720,3cyclictest0-21swapper/011:56:280
3171347992719,5cyclictest3386440-21latency_hist10:45:000
3171347992719,5cyclictest3380367-21ntpq10:36:360
34901412260,2sleep1281rcuc/112:26:421
3171355992623,1cyclictest3441713-21cut11:41:292
3171355992622,3cyclictest3316874-21cron09:35:002
3171355992622,3cyclictest3267190-21kworker/u8:1+flush-8:010:36:442
3171355992622,3cyclictest3178380-21kworker/u8:1+flush-8:007:40:012
3171355992622,2cyclictest3268053-21cut08:46:272
3171355992621,3cyclictest3435744-21unixbench_singl11:31:432
3171352992622,3cyclictest3465753-21cron12:05:001
3171352992622,3cyclictest3267190-21kworker/u8:1+flush-8:009:54:041
3171352992621,3cyclictest3341640-21munin-run10:00:001
3171352992620,4cyclictest3192077-21needreboot07:26:371
3171347992620,4cyclictest3321564-21kworker/u8:2+events_unbound09:46:410
3171347992620,4cyclictest3256436-21kworker/u8:0+flush-8:009:21:420
3171347992618,6cyclictest3436032-21kworker/u8:2+flush-8:012:16:380
3171347992618,6cyclictest3267190-21kworker/u8:1+flush-8:010:56:320
3171355992522,2cyclictest3496016-21aten2_r5power_c12:36:262
3171355992520,4cyclictest3171186-21kworker/u8:0+events_unbound08:21:462
317135599251,22cyclictest401-21dbus-daemon11:40:002
317135599250,8cyclictest34027101kthreadcore11:01:332
3171352992520,4cyclictest3386192-21kworker/u8:2+flush-8:010:51:281
3171352992520,4cyclictest3386192-21kworker/u8:2+flush-8:010:51:281
3171352992519,4cyclictest3267128-21unixbench_singl08:41:441
3171352992518,5cyclictest280-21systemd-journal11:20:001
317135299250,23cyclictest3381293-21munin-run10:40:001
317134799253,15cyclictest583-21snmpd11:26:240
3171347992521,3cyclictest3359572-21kworker/u8:0+flush-8:010:21:350
3171347992520,3cyclictest3461451-21fschecks_count12:01:300
3171347992520,3cyclictest3421489-21kworker/u8:3+events_unbound11:46:400
3171347992520,3cyclictest3171186-21kworker/u8:0+flush-8:007:15:050
3171347992519,4cyclictest3453087-21kthreadcore11:51:360
3171347992519,4cyclictest3396207-21sshd10:53:340
3171347992519,4cyclictest3396207-21sshd10:53:340
3171347992519,4cyclictest3161183-21kworker/u8:3+flush-8:007:36:330
3171347992519,3cyclictest0-21swapper/011:35:010
3171355992421,2cyclictest3456472-21fschecks_count11:56:322
3171355992419,4cyclictest3359572-21kworker/u8:0+events_unbound11:22:032
3171355992419,4cyclictest20977-21cron08:05:002
3171352992420,3cyclictest3342734-21irqrtprio10:01:321
3171352992420,2cyclictest3291853-21kworker/u8:3+events_unbound09:21:281
3171352992420,2cyclictest3243361-21irqcore08:21:311
3171352992419,3cyclictest0-21swapper/111:30:001
3171352992418,4cyclictest0-21swapper/112:36:321
3171352992417,6cyclictest3267190-21kworker/u8:1+flush-8:010:16:381
3171352992417,5cyclictest280-21systemd-journal11:43:331
3171352992416,6cyclictest3436032-21kworker/u8:2+flush-8:011:36:371
3171347992419,3cyclictest3267190-21kworker/u8:1+flush-8:011:06:340
3171347992419,3cyclictest0-21swapper/011:41:270
3171347992418,3cyclictest0-21swapper/008:31:230
3171355992319,2cyclictest0-21swapper/210:41:312
3171355992317,4cyclictest280-21systemd-journal10:10:002
3171352992319,3cyclictest3485727-21latency_hist12:25:001
3171352992319,2cyclictest0-21swapper/111:51:381
3171352992319,2cyclictest0-21swapper/111:21:441
3171352992319,2cyclictest0-21swapper/108:16:321
3171352992318,4cyclictest3316554-21unixbench_multi09:31:441
3171352992317,4cyclictest3232253-21unixbench_singl08:06:431
3171352992317,4cyclictest3208206-21apt-get07:46:241
3171352992317,4cyclictest3207541-21grep07:41:441
3171352992314,7cyclictest3226829-21ntpq08:01:391
3171352992314,7cyclictest280-21systemd-journal10:28:341
3171347992319,3cyclictest3490738-21systemd-run12:30:000
3171347992318,3cyclictest3371469-21latency_hist10:30:010
3171347992318,3cyclictest3335620-21wc09:51:360
3171347992318,3cyclictest0-21swapper/010:16:420
3171347992317,4cyclictest3470392-21unixbench_singl12:06:440
3171347992315,4cyclictest0-21swapper/010:06:240
3171347992311,8cyclictest141ktimers/008:21:250
317135599229,2cyclictest421rcuog/212:11:282
3171355992219,2cyclictest3228230-21fschecks_count08:06:282
3171355992218,3cyclictest3421215-21awk11:20:002
3171355992218,2cyclictest3322303-21aten2_r5power_v09:41:262
3171355992218,2cyclictest3183543-21aten2_r5power_p07:21:272
317135599221,5cyclictest371rcuc/212:06:302
317135599220,9cyclictest3491502-21seq12:31:302
3171352992218,2cyclictest0-21swapper/111:56:461
3171352992218,2cyclictest0-21swapper/107:35:001
3171352992217,3cyclictest0-21swapper/110:56:311
3171347992219,2cyclictest3414198-21kthreadcore11:11:340
3171347992218,3cyclictest3256436-21kworker/u8:0+flush-8:009:31:290
3171347992218,3cyclictest3171342-21cyclictest12:31:340
3171347992214,6cyclictest3188023-21cron07:25:000
3171347992213,7cyclictest3499769-21ntpq12:36:370
31665242223,13sleep00-21swapper/007:05:130
31665242223,13sleep00-21swapper/007:05:130
3171355992117,3cyclictest3178380-21kworker/u8:1+events_unbound07:46:562
317135599210,11cyclictest3371040-21grep10:26:432
3171352992116,3cyclictest3317954-21irqrtprio09:36:301
3171347992116,3cyclictest0-21swapper/011:25:010
317135599209,2cyclictest161rcu_preempt10:00:002
317135599208,3cyclictest421rcuog/212:16:262
317135599202,4cyclictest0-21swapper/207:25:232
3171355992015,3cyclictest39-21ksoftirqd/211:50:002
3171355992015,1cyclictest161rcu_preempt07:41:242
3171355992012,6cyclictest3376280-21cron10:35:002
3171355992012,6cyclictest3319268-21cut09:36:322
317135599200,9cyclictest34901402sensors12:26:422
317135599200,6cyclictest3233358-21if_enp4s0.308:11:302
317135599200,2cyclictest161rcu_preempt10:11:432
3171352992012,6cyclictest3346875-21sshd10:05:341
3171347992016,2cyclictest0-21swapper/009:16:320
3171347992015,2cyclictest0-21swapper/008:26:250
3171347992014,3cyclictest0-21swapper/011:20:000
317135599192,4cyclictest0-21swapper/209:16:392
317135599191,8cyclictest0-21swapper/209:51:292
3171355991915,3cyclictest3282233-21cron09:00:002
3171355991915,3cyclictest3267190-21kworker/u8:1+events_unbound10:00:012
3171355991915,2cyclictest0-21swapper/209:15:012
3171355991913,4cyclictest3261574-21needreboot08:36:372
3171355991912,1cyclictest161rcu_preempt08:40:592
3171355991911,6cyclictest3303709-21cut09:21:322
317135599190,5cyclictest3410035-21cut11:06:342
3171352991913,4cyclictest0-21swapper/109:16:271
317134799192,11cyclictest280-21systemd-journal09:36:380
31666032194,9sleep20-21swapper/207:06:152
31666032194,9sleep20-21swapper/207:06:152
317135599183,2cyclictest0-21swapper/209:25:052
317135599183,2cyclictest0-21swapper/208:55:002
3171355991814,2cyclictest0-21swapper/211:26:352
3171347991814,2cyclictest0-21swapper/010:01:450
317135599172,7cyclictest0-21swapper/211:11:392
32877922164,9sleep30-21swapper/309:06:283
33694002150,4chrt481ktimers/310:26:333
34163162142,6sleep30-21swapper/311:15:023
31737132144,6sleep30-21swapper/307:11:343
33377392133,7sleep30-21swapper/309:56:323
33070342132,6sleep30-21swapper/309:25:023
32974762132,6sleep30-21swapper/309:16:273
32692562132,7sleep30-21swapper/308:46:333
32496642132,7sleep30-21swapper/308:26:353
32078352132,6sleep30-21swapper/307:45:013
34905892122,6sleep30-21swapper/312:28:343
34682702122,6sleep30-21swapper/312:06:343
34552382122,6sleep30-21swapper/311:51:463
34410892122,5sleep30-21swapper/311:40:023
34234532122,6sleep30-21swapper/311:21:363
34122452122,6sleep30-21swapper/311:11:323
34097982123,5sleep30-21swapper/311:06:353
33971332122,6sleep30-21swapper/310:56:323
33811002122,6sleep30-21swapper/310:38:343
33762782122,5sleep30-21swapper/310:35:013
33588452122,6sleep30-21swapper/310:16:353
33555652123,5sleep30-21swapper/310:11:373
33416652122,5sleep30-21swapper/310:00:013
33288382122,6sleep30-21swapper/309:46:333
33267802121,7sleep30-21swapper/309:45:003
33216142122,6sleep30-21swapper/309:37:343
33128002122,6sleep30-21swapper/309:31:323
33069592122,6sleep30-21swapper/309:24:343
32817092123,6sleep30-21swapper/308:56:443
32633462122,6sleep30-21swapper/308:41:323
32574182122,5sleep30-21swapper/308:35:013
32530652122,6sleep30-21swapper/308:31:283
32436882122,6sleep30-21swapper/308:21:333
32403032122,6sleep30-21swapper/308:16:353
32347452121,7sleep30-21swapper/308:11:343
32228612122,5sleep30-21swapper/308:00:023
32180662122,6sleep30-21swapper/307:56:213
31982972122,6sleep30-21swapper/307:36:263
31937052122,6sleep30-21swapper/307:31:293
31837072122,6sleep30-21swapper/307:21:293
31825142122,6sleep30-21swapper/307:16:483
34959582112,6sleep30-21swapper/312:36:243
34909382112,5sleep30-21swapper/312:30:023
34756322112,5sleep30-21swapper/312:15:013
34616332112,6sleep30-21swapper/312:01:333
34561792112,5sleep30-21swapper/311:56:273
34463292112,5sleep30-21swapper/311:46:243
34363492112,6sleep30-21swapper/311:35:483
34351372112,5sleep30-21swapper/311:31:353
34265732112,5sleep30-21swapper/311:26:253
34018902112,5sleep30-21swapper/311:01:293
33915352112,5sleep30-21swapper/310:50:013
33915352112,5sleep30-21swapper/310:50:013
33870472112,5sleep30-21swapper/310:46:283
33818062112,5sleep30-21swapper/310:41:233
33618102112,6sleep30-21swapper/310:21:283
33472122112,6sleep30-21swapper/310:06:273
33318442112,5sleep30-21swapper/309:50:023
32927752112,5sleep30-21swapper/309:11:283
32726142112,5sleep30-21swapper/308:50:023
32279472112,5sleep30-21swapper/308:06:243
32131612112,6sleep30-21swapper/307:51:273
32085192112,5sleep30-21swapper/307:46:303
31882932112,5sleep30-21swapper/307:25:313
34811002102,4sleep30-21swapper/312:21:273
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional