You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-03 - 10:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Sun May 03, 2026 00:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
823650995238,10cyclictest121ktimers/022:45:120
823656995145,4cyclictest841216-21kworker/u8:0+events_unbound20:07:202
823661994936,6cyclictest933103-21kworker/u8:2+events_unbound00:33:173
823656994835,9cyclictest311ktimers/223:40:102
823656994723,6cyclictest131rcu_preempt00:00:132
823656994636,4cyclictest923100-21kworker/u8:3+events_unbound23:58:122
823656994620,7cyclictest131rcu_preempt21:30:122
823656994534,6cyclictest922426-21unixbench_multi23:50:252
823653994535,7cyclictest929465-21grep00:10:261
823656994236,4cyclictest925985-21kworker/u8:0+events_unbound00:28:182
823650994231,6cyclictest0-21swapper/022:17:470
823656994134,5cyclictest905474-21kworker/u8:1+events_unbound23:08:022
823661993932,4cyclictest827583-21cron19:20:013
823653993928,6cyclictest0-21swapper/123:33:041
823650993930,6cyclictest827583-21cron19:20:010
823661993833,3cyclictest851898-21cron20:30:003
823661993830,4cyclictest839741-21auditctl19:55:013
823661993829,6cyclictest0-21swapper/321:40:003
823661993825,5cyclictest857250-21kworker/u8:0+events_unbound21:45:323
823653993827,7cyclictest935405-21grep00:30:151
82366199379,15cyclictest131rcu_preempt20:05:133
823661993726,7cyclictest0-21swapper/300:13:123
823661993719,6cyclictest891724-21kworker/u8:3+events_unbound22:25:073
823661993719,6cyclictest891724-21kworker/u8:3+events_unbound22:25:073
823656993729,4cyclictest0-21swapper/219:10:242
82365699371,14cyclictest0-21swapper/223:00:102
823653993730,4cyclictest0-21swapper/121:15:161
823653993728,5cyclictest827580-21cron19:20:001
823650993725,8cyclictest928207-21cron00:09:590
823650993725,8cyclictest896683-21grep22:35:250
823650993725,8cyclictest896683-21grep22:35:240
823661993628,4cyclictest0-21swapper/322:07:443
823661993627,6cyclictest0-21swapper/300:20:003
823661993626,8cyclictest918917-21kworker/u8:2+events_unbound23:53:093
823661993626,6cyclictest0-21swapper/321:20:013
823656993621,6cyclictest898499-21kworker/u8:3+events_unbound22:48:282
823653993628,4cyclictest0-21swapper/123:00:131
823653993627,6cyclictest231ktimers/122:25:111
823653993627,6cyclictest231ktimers/122:25:111
823661993528,4cyclictest0-21swapper/319:40:013
823656993527,5cyclictest857250-21kworker/u8:0+events_unbound21:25:192
823656993526,6cyclictest0-21swapper/222:59:592
823656993525,6cyclictest0-21swapper/222:40:242
823656993525,6cyclictest0-21swapper/222:40:232
823656993524,7cyclictest891800-21latency_hist22:25:002
823653993524,7cyclictest912031-21grep23:20:251
823650993528,4cyclictest0-21swapper/021:35:270
823650993524,8cyclictest921017-21apt-key23:50:010
823661993426,5cyclictest0-21swapper/300:40:003
823661993425,6cyclictest0-21swapper/323:00:003
823661993425,6cyclictest0-21swapper/320:00:013
823661993424,6cyclictest905143-21grep23:00:233
823656993423,7cyclictest0-21swapper/223:25:232
823656993411,12cyclictest131rcu_preempt21:40:132
823650993427,3cyclictest0-21swapper/020:50:000
823650993425,6cyclictest0-21swapper/000:15:160
823661993324,7cyclictest830800-21kworker/u8:2+events_unbound19:47:143
823661993324,5cyclictest865554-21munin-run21:10:003
82366199331,18cyclictest0-21swapper/322:10:123
823656993326,5cyclictest848322-21kworker/u8:3+events_unbound21:12:332
823656993324,6cyclictest0-21swapper/223:35:012
823656993324,5cyclictest0-21swapper/200:10:252
823656993323,7cyclictest825779-21cut19:15:032
823656993322,7cyclictest920513-21grep23:45:242
823656993322,7cyclictest0-21swapper/223:18:012
823656993317,5cyclictest830800-21kworker/u8:2+events_unbound19:41:212
823656993310,13cyclictest32-21ksoftirqd/220:20:212
823653993324,5cyclictest0-21swapper/121:45:151
823653993323,6cyclictest880627-21grep21:50:261
823653993322,8cyclictest844865-21apt-get20:10:011
823650993325,4cyclictest0-21swapper/021:55:250
823650993325,4cyclictest0-21swapper/021:55:250
823661993225,4cyclictest858725-21kthreadd20:50:003
823661993225,4cyclictest0-21swapper/323:55:173
823661993224,4cyclictest0-21swapper/321:00:013
823661993224,4cyclictest0-21swapper/321:00:013
823661993224,4cyclictest0-21swapper/320:10:163
823661993221,5cyclictest894691-21kworker/u8:1+events_unbound22:48:423
823661993218,8cyclictest131rcu_preempt22:20:123
82365699329,12cyclictest0-21swapper/220:15:212
82365699327,6cyclictest131rcu_preempt22:50:182
823656993224,4cyclictest0-21swapper/223:35:262
823656993224,4cyclictest0-21swapper/221:50:172
823656993224,4cyclictest0-21swapper/221:05:252
823656993224,4cyclictest0-21swapper/221:00:182
823656993224,4cyclictest0-21swapper/221:00:182
823656993223,7cyclictest830800-21kworker/u8:2+events_unbound19:32:142
823656993223,7cyclictest830800-21kworker/u8:2+events_unbound19:32:132
823656993219,8cyclictest888569-21sshd22:15:052
823656993216,5cyclictest131rcu_preempt22:30:122
823656993216,5cyclictest131rcu_preempt22:30:112
823656993216,3cyclictest131rcu_preempt21:20:172
823656993213,5cyclictest131rcu_preempt19:45:142
82365699321,19cyclictest0-21swapper/222:10:162
823656993210,12cyclictest32-21ksoftirqd/221:20:002
823653993224,4cyclictest0-21swapper/121:40:251
823653993224,4cyclictest0-21swapper/121:35:271
823653993224,4cyclictest0-21swapper/120:15:241
823653993217,4cyclictest131rcu_preempt23:55:121
823650993225,4cyclictest937156-21fschecks_time00:35:150
823650993224,4cyclictest835878-21unixbench_multi19:40:260
823650993224,4cyclictest0-21swapper/000:00:270
823661993124,5cyclictest889566-21unixbench_multi22:15:263
823661993124,4cyclictest0-21swapper/300:05:253
823661993123,6cyclictest905474-21kworker/u8:1+events_unbound23:05:193
823661993123,4cyclictest0-21swapper/320:40:233
823661993122,6cyclictest836349-21munin-run19:45:013
823661993122,5cyclictest0-21swapper/300:25:013
823661993119,6cyclictest830800-21kworker/u8:2+events_unbound20:20:223
82365699318,12cyclictest131rcu_preempt00:35:172
823656993124,5cyclictest848322-21kworker/u8:3+events_unbound20:50:412
823656993123,4cyclictest0-21swapper/219:20:172
823656993120,7cyclictest882359-21grep21:55:262
823656993120,7cyclictest882359-21grep21:55:252
823656993117,3cyclictest131rcu_preempt00:20:552
823656993114,9cyclictest131rcu_preempt23:24:562
823650993124,4cyclictest0-21swapper/023:55:010
82366199303,3cyclictest131rcu_preempt23:30:113
82366199302,3cyclictest0-21swapper/323:10:123
823661993022,5cyclictest0-21swapper/321:55:003
823661993021,6cyclictest0-21swapper/322:35:003
823661993021,6cyclictest0-21swapper/322:35:003
823661993020,6cyclictest0-21swapper/323:45:003
823661993017,7cyclictest894691-21kworker/u8:1+events_unbound22:52:193
823661993013,9cyclictest131rcu_preempt19:11:443
82365699309,11cyclictest32-21ksoftirqd/219:50:242
823656993023,3cyclictest0-21swapper/220:40:002
823656993018,7cyclictest0-21swapper/223:10:272
823656993013,5cyclictest131rcu_preempt22:35:112
823656993013,5cyclictest131rcu_preempt22:35:112
823656993013,3cyclictest131rcu_preempt21:35:172
823656993013,3cyclictest131rcu_preempt19:29:392
823656993012,6cyclictest131rcu_preempt22:30:012
823656993012,6cyclictest131rcu_preempt22:30:002
823656993011,5cyclictest131rcu_preempt00:05:262
823653993022,5cyclictest828992-21kworker/u8:1+events_unbound19:37:131
823653993022,4cyclictest0-21swapper/122:50:251
823653993017,11cyclictest24-21ksoftirqd/100:05:131
823650993022,5cyclictest0-21swapper/021:00:010
823650993022,5cyclictest0-21swapper/021:00:000
823650993022,4cyclictest0-21swapper/021:45:260
823650993021,6cyclictest0-21swapper/019:25:170
823650993021,3cyclictest0-21swapper/020:40:200
823650993020,6cyclictest910299-21grep23:15:240
823661992921,5cyclictest933103-21kworker/u8:2+events_unbound00:26:223
82365699299,10cyclictest131rcu_preempt00:15:242
82365699298,12cyclictest32-21ksoftirqd/220:26:482
82365699298,11cyclictest32-21ksoftirqd/222:05:002
82365699298,11cyclictest32-21ksoftirqd/222:05:002
82365699298,11cyclictest32-21ksoftirqd/220:40:232
82365699297,12cyclictest32-21ksoftirqd/220:05:012
823653992919,7cyclictest872583-21sh21:30:001
823653992919,7cyclictest0-21swapper/119:55:261
823653992918,8cyclictest231ktimers/100:15:131
823653992918,7cyclictest884526-21audit_send_reply22:05:011
823653992918,7cyclictest884526-21audit_send_reply22:05:001
823653992918,7cyclictest0-21swapper/119:30:011
823653992917,8cyclictest0-21swapper/123:40:001
823650992922,4cyclictest0-21swapper/022:20:170
823650992922,3cyclictest0-21swapper/019:35:000
823650992922,3cyclictest0-21swapper/019:35:000
823650992921,4cyclictest0-21swapper/022:10:000
82366199288,10cyclictest4034480-21kworker/3:1-mm_percpu_wq21:30:133
82366199284,11cyclictest848084-21users20:15:243
823661992822,4cyclictest848322-21kworker/u8:3+events_unbound20:32:263
823661992821,4cyclictest0-21swapper/323:35:153
823661992820,5cyclictest0-21swapper/323:45:243
823661992818,6cyclictest0-21swapper/323:15:233
823661992817,7cyclictest0-21swapper/320:55:003
823661992816,5cyclictest827203-21kworker/u8:2+events_unbound19:20:033
823661992813,7cyclictest131rcu_preempt19:25:113
82366199281,15cyclictest0-21swapper/321:02:563
82366199281,15cyclictest0-21swapper/321:02:563
82365699288,11cyclictest131rcu_preempt20:10:242
82365699286,12cyclictest32-21ksoftirqd/222:05:142
823653992821,4cyclictest897088-21kthreadd22:40:011
823653992821,4cyclictest897088-21kthreadd22:40:001
823653992821,4cyclictest824809-21unixbench_multi19:10:251
823653992820,5cyclictest24-21ksoftirqd/122:10:131
823653992820,4cyclictest0-21swapper/119:20:251
823650992822,3cyclictest0-21swapper/022:30:250
823650992822,3cyclictest0-21swapper/022:30:250
823650992821,4cyclictest905619-21cron23:05:010
823650992820,5cyclictest0-21swapper/021:55:000
823650992820,4cyclictest0-21swapper/022:50:140
823650992820,4cyclictest0-21swapper/020:55:000
823650992818,6cyclictest0-21swapper/020:25:230
82366199274,11cyclictest40-21ksoftirqd/321:14:303
823661992720,5cyclictest913853-21kworker/u8:2+events_unbound23:28:423
823661992720,5cyclictest857250-21kworker/u8:0+events_unbound22:40:133
823661992720,5cyclictest857250-21kworker/u8:0+events_unbound22:40:123
823661992720,4cyclictest0-21swapper/321:55:253
823661992720,4cyclictest0-21swapper/321:55:253
823661992714,7cyclictest131rcu_preempt21:25:133
82365699278,11cyclictest32-21ksoftirqd/220:31:142
82365699276,11cyclictest131rcu_preempt21:45:152
823656992719,5cyclictest0-21swapper/219:40:002
823656992718,5cyclictest0-21swapper/221:00:002
823656992718,5cyclictest0-21swapper/221:00:002
823653992719,4cyclictest0-21swapper/122:25:011
823653992719,4cyclictest0-21swapper/120:30:011
823653992718,5cyclictest865067-21tail21:05:261
823653992718,5cyclictest0-21swapper/120:50:161
823653992716,7cyclictest925824-21grep00:00:271
823650992719,4cyclictest0-21swapper/020:00:260
823661992612,8cyclictest131rcu_preempt20:00:263
823656992614,4cyclictest131rcu_preempt20:45:152
823656992614,10cyclictest839974-21/usr/sbin/munin19:55:182
823653992619,4cyclictest0-21swapper/123:50:231
823653992617,7cyclictest231ktimers/120:20:111
823653992617,6cyclictest0-21swapper/123:40:241
823653992617,5cyclictest0-21swapper/120:35:001
823653992615,7cyclictest921032-21apt-config23:50:011
823650992620,3cyclictest0-21swapper/019:50:240
823650992614,8cyclictest935040-21ls00:30:000
82366199259,8cyclictest131rcu_preempt21:23:413
82366199259,10cyclictest131rcu_preempt00:02:313
82366199252,3cyclictest131rcu_preempt22:00:133
82366199252,3cyclictest131rcu_preempt22:00:123
823661992518,4cyclictest0-21swapper/322:35:253
823661992518,4cyclictest0-21swapper/322:35:243
823661992513,3cyclictest131rcu_preempt21:40:123
82366199251,13cyclictest0-21swapper/319:30:043
82366199251,13cyclictest0-21swapper/319:30:043
823653992517,5cyclictest0-21swapper/122:30:261
823653992517,5cyclictest0-21swapper/122:30:251
823653992516,6cyclictest854531-21/usr/sbin/munin20:35:231
82365099252,19cyclictest906085-21fschecks_time23:05:150
823650992520,3cyclictest825555-21latency_hist19:15:010
823650992519,3cyclictest0-21swapper/019:25:000
823650992518,5cyclictest208-21systemd-logind20:20:400
823650992518,5cyclictest164-21systemd-journal20:18:400
823650992518,3cyclictest0-21swapper/021:20:260
82365099251,5cyclictest913212-21ntp_kernel_pll_23:25:190
823650992515,7cyclictest868544-21grep21:15:260
82365099251,20cyclictest0-21swapper/022:43:030
82365099251,20cyclictest0-21swapper/022:43:030
82366199249,9cyclictest131rcu_preempt23:20:183
823653992418,3cyclictest0-21swapper/121:20:121
823653992417,4cyclictest0-21swapper/120:10:221
823653992413,7cyclictest204-21dbus-daemon00:28:151
823653992410,9cyclictest910741-21cat23:20:011
823650992418,4cyclictest208-21systemd-logind19:38:410
823650992418,3cyclictest0-21swapper/020:10:020
823650992417,5cyclictest208-21systemd-logind19:56:400
823650992417,3cyclictest0-21swapper/022:14:590
823650992416,4cyclictest0-21swapper/021:27:360
82365099241,20cyclictest0-21swapper/023:32:420
82365099241,19cyclictest0-21swapper/021:03:580
82365099241,19cyclictest0-21swapper/021:03:580
82365099241,19cyclictest0-21swapper/020:38:520
82365099241,19cyclictest0-21swapper/000:10:500
82366199236,11cyclictest40-21ksoftirqd/320:35:173
823653992318,3cyclictest0-21swapper/121:30:191
823653992317,3cyclictest0-21swapper/123:10:191
823653992315,5cyclictest0-21swapper/100:20:251
823653992315,4cyclictest0-21swapper/123:10:001
823653992315,4cyclictest0-21swapper/122:15:271
823653992314,5cyclictest0-21swapper/119:45:001
823650992316,3cyclictest0-21swapper/023:37:000
823650992315,4cyclictest0-21swapper/023:55:250
82365099231,18cyclictest0-21swapper/021:11:130
82365099231,18cyclictest0-21swapper/021:09:380
82365099231,18cyclictest0-21swapper/020:31:280
82365099230,21cyclictest0-21swapper/022:25:220
82365099230,21cyclictest0-21swapper/022:25:210
82365099230,19cyclictest0-21swapper/023:22:360
823653992216,3cyclictest0-21swapper/122:05:251
823653992216,3cyclictest0-21swapper/120:40:221
823653992216,3cyclictest0-21swapper/100:35:261
823653992215,4cyclictest836789-21fschecks_time19:45:171
82365399221,4cyclictest897352-21wc22:40:121
82365399221,4cyclictest897352-21wc22:40:121
823653992213,6cyclictest0-21swapper/123:25:191
823653992212,6cyclictest231ktimers/120:50:021
823653992211,7cyclictest0-21swapper/121:10:251
82365099221,8cyclictest907650-21awk23:10:140
823650992218,2cyclictest13850irq/36-mmc120:10:120
823650992216,3cyclictest0-21swapper/000:30:110
823650992216,3cyclictest0-21swapper/000:20:260
823650992216,2cyclictest0-21swapper/021:31:560
82365099221,3cyclictest629-21snmpd23:40:200
82365099221,19cyclictest0-21swapper/019:47:360
82365099220,18cyclictest0-21swapper/022:04:350
82365099220,18cyclictest0-21swapper/022:04:350
823653992113,4cyclictest861666-21unixbench_multi20:55:251
823653992113,4cyclictest861666-21unixbench_multi20:55:251
823653992112,6cyclictest881890-21ntpq21:55:211
823653992112,6cyclictest881890-21ntpq21:55:201
823653992111,7cyclictest863850-21ls21:05:011
823653992111,7cyclictest863850-21ls21:05:001
82365099211,18cyclictest0-21swapper/021:41:410
823653991913,3cyclictest0-21swapper/119:50:171
823653991911,5cyclictest0-21swapper/122:45:161
82365399191,12cyclictest832931-21grep19:35:011
82365399191,12cyclictest832931-21grep19:35:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional