You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-13 - 23:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Wed May 13, 2026 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3651003995141,6cyclictest3682452-21munin-plugin-st08:40:002
3650999994738,6cyclictest208-21systemd-logind11:30:191
3651007994639,4cyclictest3679038-21idleruntime-cro08:30:003
3651003994633,9cyclictest311ktimers/209:45:132
3650993994639,4cyclictest3742769-21cron11:35:000
3651007994435,5cyclictest3668795-21munin-plugin-st08:00:013
3651007994432,8cyclictest391ktimers/309:25:113
3651003994432,8cyclictest3739821-21fschecks_time11:25:162
3651007994334,6cyclictest3682012-21unixbench_singl08:35:223
3651007994333,7cyclictest3694508-21latency_hist09:15:013
3651003994232,6cyclictest3664910-21grep07:45:222
3650999994234,4cyclictest0-21swapper/109:00:011
3650993994235,4cyclictest3696303-21cron09:20:000
3650993994235,4cyclictest3675625-21sendmail08:20:010
3651007994133,4cyclictest0-21swapper/311:40:003
3651007994127,10cyclictest391ktimers/310:40:113
3651003994135,4cyclictest3749822-21kworker/u8:3+events_unbound12:05:272
3651003994129,5cyclictest3652374-21kworker/u8:2+events_unbound07:29:292
3651003994127,11cyclictest311ktimers/212:10:112
3651003994121,7cyclictest131rcu_preempt11:10:132
3651003994028,8cyclictest3730415-21grep10:55:252
3651003994028,7cyclictest0-21swapper/208:50:262
3650999994033,4cyclictest3758354-21idleruntime-cro12:20:011
3650999994032,4cyclictest0-21swapper/111:40:001
3650999994032,4cyclictest0-21swapper/110:20:001
3650999994032,4cyclictest0-21swapper/110:20:001
3650999994030,8cyclictest3704836-21sh09:45:001
3651003993930,5cyclictest0-21swapper/209:00:012
3650999993932,4cyclictest0-21swapper/108:05:011
3651007993831,4cyclictest3751311-21sendmail12:00:003
3651007993829,4cyclictest0-21swapper/311:50:233
3650999993830,4cyclictest0-21swapper/107:20:001
3651003993731,4cyclictest3758187-21kworker/u8:0+events_unbound12:20:292
3651003993728,5cyclictest0-21swapper/211:00:162
3651003993726,7cyclictest3763194-21grep12:30:232
3650993993731,4cyclictest3650986-21cyclictest12:05:000
3650993993728,6cyclictest0-21swapper/009:10:250
3650993993727,6cyclictest0-21swapper/007:50:260
3651007993626,7cyclictest3724023-21sendmail10:40:013
3651003993628,4cyclictest0-21swapper/210:40:152
3651003993626,7cyclictest3707757-21grep09:50:242
3651003993624,9cyclictest311ktimers/207:15:112
3650993993627,6cyclictest0-21swapper/010:55:010
3650993993626,5cyclictest0-21swapper/009:00:260
3650993993625,7cyclictest0-21swapper/007:25:260
3651007993528,4cyclictest3689253-21cron09:00:003
3651003993528,5cyclictest3765080-21kworker/u8:2+events_unbound12:36:392
3651003993520,4cyclictest131rcu_preempt11:55:022
3650999993528,4cyclictest3708235-21cron09:55:011
3650999993527,5cyclictest3761764-21munin-plugin-st12:30:011
3650993993525,5cyclictest0-21swapper/012:05:250
3650993993524,7cyclictest0-21swapper/010:45:250
3651003993425,7cyclictest3702961-21kworker/u8:1+events_unbound09:39:522
3651003993425,7cyclictest311ktimers/211:50:102
3651003993419,11cyclictest311ktimers/208:25:122
3651003993417,10cyclictest131rcu_preempt10:17:002
3651003993417,10cyclictest131rcu_preempt10:17:002
3651003993415,5cyclictest131rcu_preempt10:30:172
3650999993426,4cyclictest0-21swapper/108:15:011
3650999993424,7cyclictest0-21swapper/111:00:001
3650993993426,5cyclictest0-21swapper/012:40:000
3650993993423,8cyclictest121ktimers/009:05:100
3651007993327,4cyclictest3729044-21kworker/u8:2+events_unbound11:05:143
3651007993327,4cyclictest3729044-21kworker/u8:2+events_unbound11:05:143
3651007993327,3cyclictest3758340-21kthreadd12:20:013
3651003993319,6cyclictest131rcu_preempt11:05:192
3651003993319,6cyclictest131rcu_preempt11:05:192
3651003993318,5cyclictest3734213-21kworker/u8:3+events_unbound11:37:222
3651003993312,12cyclictest32-21ksoftirqd/208:30:132
3650999993325,6cyclictest3725574-21kworker/u8:3+events_unbound10:45:091
3650999993325,4cyclictest3754726-21kthreadd12:10:011
3650993993325,4cyclictest0-21swapper/010:00:010
3650993993324,5cyclictest0-21swapper/010:40:010
3650993993323,6cyclictest0-21swapper/007:45:230
3650993993323,5cyclictest0-21swapper/007:15:260
3651007993227,3cyclictest3668766-21kworker/u8:1+events_unbound08:44:433
3651007993227,3cyclictest3668766-21kworker/u8:1+events_unbound08:44:433
3651007993224,4cyclictest0-21swapper/311:00:253
365100399328,5cyclictest131rcu_preempt10:25:242
3651003993226,4cyclictest3687173-21kworker/u8:3+events_unbound09:24:492
3651003993225,5cyclictest3711508-21kworker/u8:0+events_unbound10:03:412
3651003993223,5cyclictest3685438-21grep08:45:252
3651003993218,3cyclictest131rcu_preempt09:33:412
3651003993216,3cyclictest131rcu_preempt07:33:272
3651003993216,3cyclictest131rcu_preempt07:13:032
3651003993215,3cyclictest131rcu_preempt10:14:382
3651003993213,11cyclictest0-21swapper/207:35:092
3651003993210,11cyclictest32-21ksoftirqd/209:00:252
3650999993224,5cyclictest0-21swapper/109:25:011
3650993993222,6cyclictest0-21swapper/010:05:270
3651007993124,5cyclictest391ktimers/308:00:143
365100399317,4cyclictest131rcu_preempt11:40:172
365100399317,4cyclictest131rcu_preempt11:40:162
3651003993125,4cyclictest2852758-21kworker/u8:0+events_unbound07:24:262
3651003993124,5cyclictest3692390-21kworker/u8:0+events_unbound09:10:412
3651003993124,3cyclictest0-21swapper/207:55:162
3651003993118,5cyclictest131rcu_preempt11:45:132
3651003993115,6cyclictest131rcu_preempt07:44:132
3651003993115,3cyclictest131rcu_preempt11:20:432
3651003993111,4cyclictest131rcu_preempt12:03:182
3651003993110,12cyclictest32-21ksoftirqd/211:35:012
3650999993123,4cyclictest0-21swapper/112:25:011
3650999993122,6cyclictest0-21swapper/108:20:011
3650999993120,7cyclictest0-21swapper/111:15:241
3650993993122,5cyclictest0-21swapper/011:15:000
3651007993024,4cyclictest3749822-21kworker/u8:3+events_unbound12:25:313
3651007993023,4cyclictest3666668-21grep07:50:263
3651007993022,4cyclictest0-21swapper/312:35:003
3651007993022,4cyclictest0-21swapper/310:00:003
3651007993022,4cyclictest0-21swapper/309:20:263
3651007993020,6cyclictest0-21swapper/307:40:263
365100399308,6cyclictest32-21ksoftirqd/209:05:212
365100399308,13cyclictest32-21ksoftirqd/208:00:262
365100399307,13cyclictest32-21ksoftirqd/212:25:192
3651003993016,5cyclictest131rcu_preempt08:40:212
3651003993016,5cyclictest131rcu_preempt08:40:202
365100399301,13cyclictest0-21swapper/209:15:282
3651003993010,12cyclictest32-21ksoftirqd/210:20:202
3651003993010,12cyclictest32-21ksoftirqd/210:20:202
3650999993023,4cyclictest0-21swapper/108:45:241
3650999993022,6cyclictest3729044-21kworker/u8:2+events_unbound11:00:131
3650999993022,4cyclictest0-21swapper/111:45:251
3650999993021,4cyclictest0-21swapper/109:29:501
3650999993020,6cyclictest0-21swapper/110:20:251
3650999993020,6cyclictest0-21swapper/110:20:251
3650993993020,6cyclictest0-21swapper/010:20:240
3650993993020,6cyclictest0-21swapper/010:20:240
3650993993020,6cyclictest0-21swapper/008:35:230
3650993993018,9cyclictest3737238-21grep11:15:240
3650993993015,9cyclictest131rcu_preempt09:22:470
3651007992922,4cyclictest3668766-21kworker/u8:1+events_unbound08:50:153
3651007992921,6cyclictest3723774-21kworker/u8:0+events_unbound11:25:193
3651007992921,4cyclictest0-21swapper/307:25:263
3651007992920,4cyclictest0-21swapper/311:20:003
365100399299,11cyclictest32-21ksoftirqd/208:10:242
3651003992918,5cyclictest131rcu_preempt09:59:032
3651003992918,4cyclictest131rcu_preempt09:26:542
3651003992916,5cyclictest131rcu_preempt08:15:242
3651003992915,3cyclictest131rcu_preempt10:07:462
3651003992915,12cyclictest3665617-21/usr/sbin/munin07:50:192
3651003992910,12cyclictest32-21ksoftirqd/211:15:152
3651003992910,11cyclictest131rcu_preempt08:25:012
3650999992922,4cyclictest0-21swapper/109:05:011
3650999992922,4cyclictest0-21swapper/107:10:261
3650999992920,6cyclictest3765376-21sendmail12:40:001
3650999992920,6cyclictest0-21swapper/110:55:011
3650999992920,5cyclictest0-21swapper/108:25:001
3650999992919,7cyclictest3762375-21tune2fs12:30:151
3650999992919,6cyclictest0-21swapper/108:40:161
3650999992919,6cyclictest0-21swapper/108:40:161
3650993992921,4cyclictest0-21swapper/011:50:000
3650993992920,6cyclictest0-21swapper/010:00:160
3650993992920,6cyclictest0-21swapper/009:50:010
3651007992823,3cyclictest3655386-21kworker/u8:3+events_unbound08:09:363
3651007992821,5cyclictest3723774-21kworker/u8:0+events_unbound10:55:123
3651007992821,3cyclictest0-21swapper/309:00:263
3651007992819,5cyclictest0-21swapper/312:05:253
365100399284,6cyclictest32-21ksoftirqd/208:05:242
3651003992820,6cyclictest3725574-21kworker/u8:3+events_unbound10:54:402
3651003992814,3cyclictest131rcu_preempt10:35:202
3651003992810,10cyclictest32-21ksoftirqd/212:20:012
3650999992821,4cyclictest0-21swapper/109:45:161
3650999992820,4cyclictest0-21swapper/111:25:001
3650999992818,7cyclictest3703132-21run-parts09:40:011
3650999992815,10cyclictest231ktimers/112:10:131
3650999992814,11cyclictest231ktimers/109:30:131
3650993992821,4cyclictest0-21swapper/008:50:000
3650993992820,4cyclictest0-21swapper/012:20:010
3650993992820,4cyclictest0-21swapper/011:30:000
3650993992819,5cyclictest0-21swapper/010:40:140
365100799277,4cyclictest0-21swapper/310:55:023
3651007992720,3cyclictest0-21swapper/307:30:263
3651007992719,4cyclictest0-21swapper/311:30:163
3651007992719,4cyclictest0-21swapper/309:50:243
3651007992718,6cyclictest3654940-21sh07:20:003
3651007992717,7cyclictest3664397-21cat07:45:183
365100399276,6cyclictest32-21ksoftirqd/209:40:252
3650999992720,4cyclictest0-21swapper/112:00:241
3650999992718,6cyclictest0-21swapper/107:50:251
3650999992717,7cyclictest231ktimers/111:10:141
3650993992722,3cyclictest3699885-21latency_hist09:30:010
3650993992721,3cyclictest0-21swapper/011:39:590
3650993992718,6cyclictest0-21swapper/008:40:260
3650993992718,6cyclictest0-21swapper/008:40:260
3650993992717,6cyclictest0-21swapper/010:55:250
3650999992619,5cyclictest231ktimers/109:15:121
3650999992618,4cyclictest0-21swapper/108:30:011
3650999992616,7cyclictest3680966-21apt-get08:35:101
3650993992619,5cyclictest3652374-21kworker/u8:2+events_unbound07:35:000
3650993992619,4cyclictest0-21swapper/011:55:250
3650993992615,8cyclictest3663253-21grep07:40:260
365099399261,4cyclictest3748693-21ntp_states11:50:200
3650993992614,7cyclictest0-21swapper/007:35:260
3651007992519,3cyclictest0-21swapper/310:10:003
3651007992519,3cyclictest0-21swapper/308:45:253
3651007992517,5cyclictest0-21swapper/308:15:163
3651007992517,4cyclictest0-21swapper/309:30:253
3651007992516,5cyclictest3661973-21grep07:40:003
3651007992515,6cyclictest0-21swapper/312:20:233
3650999992519,3cyclictest0-21swapper/110:40:011
3650999992517,5cyclictest3711508-21kworker/u8:0+events_unbound10:15:011
3650999992514,8cyclictest3658897-21ls07:30:151
3650993992518,5cyclictest3695008-21kworker/u8:2+events_unbound09:54:560
3650993992518,4cyclictest0-21swapper/010:25:150
3650993992518,4cyclictest0-21swapper/009:30:250
3650993992518,3cyclictest0-21swapper/010:15:240
3650993992518,3cyclictest0-21swapper/010:15:230
3650993992518,3cyclictest0-21swapper/007:20:260
3650993992517,5cyclictest0-21swapper/012:20:250
3650993992517,5cyclictest0-21swapper/009:40:010
365099399251,5cyclictest3762305-21df12:30:130
3650993992515,7cyclictest3668802-21ls08:00:010
3650993992515,6cyclictest0-21swapper/007:15:010
3651007992417,3cyclictest0-21swapper/310:15:243
3651007992417,3cyclictest0-21swapper/310:15:243
3651007992416,5cyclictest0-21swapper/308:20:173
3651007992415,6cyclictest145-21jbd2/mmcblk1p2-808:30:223
3651007992415,6cyclictest0-21swapper/309:20:003
3651007992414,7cyclictest3764811-21wc12:35:243
3650999992418,4cyclictest231ktimers/107:45:101
3650999992418,3cyclictest0-21swapper/110:00:011
3650999992415,6cyclictest3671731-21awk08:05:241
365099999241,4cyclictest3713368-21grep10:05:271
3650999992412,9cyclictest231ktimers/110:40:121
365099399249,11cyclictest151rcuc/008:55:230
3650993992416,6cyclictest3676708-21timerandwakeup08:20:260
3650993992416,4cyclictest0-21swapper/011:05:240
3650993992416,4cyclictest0-21swapper/011:05:240
3650993992415,5cyclictest0-21swapper/008:53:450
365099399241,19cyclictest0-21swapper/008:14:100
3651007992318,2cyclictest0-21swapper/311:20:113
3651007992317,4cyclictest3687173-21kworker/u8:3+events_unbound09:09:473
3651007992316,5cyclictest3701164-21kworker/u8:0+events_unbound09:38:423
3651007992316,4cyclictest3652174-21grep07:10:263
3651007992315,5cyclictest145-21jbd2/mmcblk1p2-811:10:503
3651007992314,6cyclictest3753031-21basename12:05:003
3651007992313,7cyclictest3755714-21ntpq12:10:213
3651007992310,10cyclictest3714609-21/usr/sbin/munin10:10:223
3650999992317,3cyclictest0-21swapper/107:40:011
3650999992313,7cyclictest3739864-21basename11:25:151
3650999992313,7cyclictest3734260-21basename11:10:001
3650999992313,7cyclictest3734260-21basename11:10:001
3650993992317,3cyclictest0-21swapper/012:30:000
3650993992316,4cyclictest0-21swapper/012:10:060
3650993992316,3cyclictest0-21swapper/010:12:090
3650993992316,3cyclictest0-21swapper/008:05:000
365099399231,5cyclictest0-21swapper/008:30:140
3650993992314,5cyclictest0-21swapper/011:20:250
365099399230,19cyclictest0-21swapper/011:42:220
365099399230,19cyclictest0-21swapper/011:42:220
3651007992216,4cyclictest3655393-21/usr/sbin/munin07:20:143
3651007992214,5cyclictest0-21swapper/310:00:253
3650999992216,3cyclictest0-21swapper/111:54:591
3650999992216,3cyclictest0-21swapper/107:40:251
3650999992213,6cyclictest3658765-21cat07:30:021
3650999992212,7cyclictest3686176-21awk08:50:141
3650999992212,7cyclictest3679838-21ntpq08:30:221
3650999992212,7cyclictest3655500-21seq07:20:151
3650999992211,8cyclictest204-21dbus-daemon10:30:041
3650993992215,3cyclictest0-21swapper/009:41:110
3650993992213,6cyclictest0-21swapper/008:25:260
365099399221,17cyclictest0-21swapper/010:31:430
3651007992115,3cyclictest0-21swapper/311:40:253
3651007992115,3cyclictest0-21swapper/311:40:253
3651007992115,3cyclictest0-21swapper/309:50:013
365099999217,9cyclictest204-21dbus-daemon09:14:461
3650999992116,2cyclictest0-21swapper/110:00:201
3650999992115,3cyclictest0-21swapper/111:55:111
3650999992115,3cyclictest0-21swapper/107:55:151
3650999992114,5cyclictest231ktimers/109:05:161
3650999992112,6cyclictest3719392-21cat10:25:161
3651007992015,3cyclictest645-21runrttasks10:20:123
3651007992015,3cyclictest645-21runrttasks10:20:113
3651007992014,3cyclictest0-21swapper/309:40:243
3651007991914,3cyclictest3719233-21cstates10:25:133
3651007991910,5cyclictest0-21swapper/311:45:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional