You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-06 - 04:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Sat Jun 06, 2026 00:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3290462995541,10cyclictest13550irq/42-30be0000.ethernet00:00:110
3290467995243,5cyclictest3342592-21head21:35:241
3290462995244,5cyclictest3353021-21kworker/u8:2+events_unbound22:26:050
3290471995042,5cyclictest3336185-21apt21:20:002
3290471995034,11cyclictest311ktimers/223:50:142
3290476994930,15cyclictest3349822-21sh22:00:003
3290471994636,5cyclictest208-21systemd-logind23:06:122
3290476994521,20cyclictest0-21swapper/322:20:003
3290476994511,29cyclictest0-21swapper/320:20:143
3290471994536,6cyclictest3344318-21grep21:40:252
3290467994431,9cyclictest231ktimers/123:10:121
3290467994431,9cyclictest231ktimers/123:10:111
3290462994435,6cyclictest3302901-21unixbench_multi19:40:230
3290462994431,11cyclictest121ktimers/019:10:130
329047699431,9cyclictest3350186-21/usr/sbin/munin22:00:153
329047699431,9cyclictest3294009-21/usr/sbin/munin19:15:263
3290476994312,26cyclictest0-21swapper/321:30:123
3290467994335,5cyclictest3370288-21sh23:00:001
3290467994330,10cyclictest231ktimers/120:40:121
3290476994235,4cyclictest3359590-21unixbench_multi22:25:263
329047699422,8cyclictest3318372-21cron20:26:013
3290476994220,18cyclictest0-21swapper/320:40:013
329047699421,13cyclictest3397796-21grep00:15:253
3290471994236,4cyclictest3375427-21kworker/u8:1+events_unbound23:21:182
3290471994235,5cyclictest3358592-21kworker/u8:0+events_unbound22:31:082
3290471994233,5cyclictest208-21systemd-logind21:50:592
3290462994235,4cyclictest3332631-21apt-config21:10:000
329047699417,8cyclictest3384035-21seq23:38:453
329047699417,30cyclictest3405083-21latency_hist00:40:003
329047699411,8cyclictest3400848-21/usr/sbin/munin00:25:263
3290476994114,22cyclictest3352831-21sed22:05:263
3290476994110,27cyclictest0-21swapper/322:45:263
3290471994135,4cyclictest3332580-21kworker/u8:0+events_unbound21:25:562
3290471994132,5cyclictest0-21swapper/219:35:012
3290462994132,6cyclictest3380343-21unixbench_singl23:25:240
329047699408,5cyclictest3328239-21ntpq20:55:223
329047699408,5cyclictest3328239-21ntpq20:55:223
329047699403,8cyclictest3362560-21/usr/sbin/munin22:35:213
329047699403,5cyclictest3302008-21diskstats19:40:143
329047699403,4cyclictest3313189-21users20:10:263
329047699401,9cyclictest3381511-21tr23:30:203
329047699401,9cyclictest3336432-21/usr/sbin/munin21:20:243
329047699401,8cyclictest3385550-21sshd23:41:213
329047699401,7cyclictest3342556-21/usr/sbin/munin21:35:243
329047699401,10cyclictest3374148-21/usr/sbin/munin23:10:233
329047699401,10cyclictest3374148-21/usr/sbin/munin23:10:233
329047699401,10cyclictest3344097-21/usr/sbin/munin21:40:243
3290462994024,12cyclictest121ktimers/000:10:120
329047699392,10cyclictest3387904-21df23:50:143
329047699391,9cyclictest3297008-21/usr/sbin/munin19:25:193
329047699391,7cyclictest3391217-21/usr/sbin/munin00:00:153
329047699391,7cyclictest3372562-21/usr/sbin/munin23:05:133
329047699391,7cyclictest3364630-21/usr/sbin/munin22:40:253
329047699391,6cyclictest3291168-21ntpq19:10:223
329047699391,11cyclictest3371417-21wc23:00:223
329047699391,11cyclictest3338245-21df21:25:153
329047699391,11cyclictest3324389-21diskstats20:45:143
329047699391,11cyclictest3313931-21diskstats20:15:143
329047699391,11cyclictest3310191-21munin-run20:05:003
329047699391,10cyclictest3367699-21/usr/sbin/munin22:50:213
329047699391,10cyclictest3307440-21/usr/sbin/munin19:55:203
329047699391,10cyclictest3307440-21/usr/sbin/munin19:55:193
329047699386,6cyclictest3331396-21/usr/sbin/munin21:05:183
329047699383,6cyclictest3377715-21fschecks_count23:20:163
329047699381,9cyclictest3345096-21fschecks_count21:45:163
329047699381,9cyclictest3305287-21munin-node19:50:113
329047699381,9cyclictest3304434-21/usr/sbin/munin19:45:253
329047699381,8cyclictest3326078-21/usr/sbin/munin20:50:153
329047699381,8cyclictest3326078-21/usr/sbin/munin20:50:143
329047699381,8cyclictest3322971-21latency20:40:183
329047699381,8cyclictest3300098-21grep19:35:153
329047699381,7cyclictest3379273-21/usr/sbin/munin23:25:213
329047699381,5cyclictest3311444-21unixbench_singl20:05:253
329047699381,11cyclictest3390575-21users23:55:263
329047699381,10cyclictest3375962-21df23:15:143
329047699381,10cyclictest3375962-21df23:15:143
3290476993810,24cyclictest3298443-21fschecks_time19:30:163
3290476993810,24cyclictest0-21swapper/320:30:203
329047699380,8cyclictest3387074-21/usr/sbin/munin23:45:243
3290471993831,4cyclictest3398220-21latency_hist00:20:002
3290471993827,7cyclictest0-21swapper/223:40:012
3290471993826,7cyclictest0-21swapper/220:40:012
3290467993828,6cyclictest0-21swapper/120:30:251
3290462993830,4cyclictest0-21swapper/019:20:240
3290462993828,6cyclictest0-21swapper/000:25:000
329047699372,11cyclictest3403329-21cron00:35:003
329047699371,9cyclictest3357019-21diskstats22:20:153
329047699371,9cyclictest3357019-21diskstats22:20:153
329047699371,8cyclictest3346981-21/usr/sbin/munin21:50:173
329047699371,6cyclictest3360300-21/usr/sbin/munin22:30:233
329047699371,5cyclictest3369007-21fschecks_time22:55:163
329047699371,4cyclictest3396074-21grep00:10:243
329047699371,12cyclictest3333144-21fschecks_count21:10:153
3290471993728,5cyclictest3292316-21munin-node19:15:012
3290471993725,8cyclictest3392894-21latency_hist00:05:012
3290462993725,8cyclictest3297552-21grep19:25:260
3290462993723,10cyclictest121ktimers/020:50:110
3290462993723,10cyclictest121ktimers/020:50:110
329047699361,8cyclictest3399261-21switchtime00:20:223
329047699361,7cyclictest3353473-21/usr/sbin/munin22:10:133
329047699361,7cyclictest3329738-21/usr/sbin/munin21:00:173
329047699361,31cyclictest3335709-21grep21:15:253
3290462993628,5cyclictest3329141-21cron21:00:000
3290462993628,5cyclictest3329141-21cron21:00:000
329047699352,5cyclictest3393761-21ps00:05:223
3290471993529,3cyclictest3390975-21latency_hist00:00:002
3290462993523,7cyclictest0-21swapper/023:45:250
3290471993428,4cyclictest3332580-21kworker/u8:0+events_unbound21:10:502
3290471993428,4cyclictest3304677-21kworker/u8:1+events_unbound19:45:312
3290471993427,5cyclictest3380634-21kworker/u8:1+events_unbound23:31:192
3290471993422,8cyclictest3294398-21auditctl19:20:002
329047199341,6cyclictest0-21swapper/222:00:122
3290467993426,4cyclictest0-21swapper/119:20:161
3290462993428,3cyclictest0-21swapper/000:35:120
3290467993325,5cyclictest3325268-21grep20:45:241
3290467993325,4cyclictest0-21swapper/119:55:251
3290467993325,4cyclictest0-21swapper/119:55:251
3290467993325,4cyclictest0-21swapper/119:30:251
3290467993323,7cyclictest3349359-21grep21:55:251
3290467993323,6cyclictest0-21swapper/121:00:241
3290462993327,3cyclictest0-21swapper/023:40:000
3290462993325,3cyclictest0-21swapper/020:20:010
3290471993226,4cyclictest3365080-21kworker/u8:0+events_unbound22:48:402
3290471993225,4cyclictest0-21swapper/221:30:162
3290471993223,5cyclictest0-21swapper/219:20:252
329047199321,12cyclictest32-21ksoftirqd/221:20:132
3290467993224,4cyclictest0-21swapper/122:40:251
3290467993224,4cyclictest0-21swapper/122:25:001
3290467993224,4cyclictest0-21swapper/122:25:001
3290467993224,4cyclictest0-21swapper/119:55:011
3290467993222,7cyclictest3340853-21grep21:30:251
3290467993222,6cyclictest0-21swapper/121:10:011
3290462993226,4cyclictest3366820-21kworker/u8:1+events_unbound22:51:110
3290462993224,5cyclictest0-21swapper/020:50:010
3290462993223,6cyclictest0-21swapper/019:35:010
3290462993222,6cyclictest0-21swapper/021:25:260
3290471993125,4cyclictest3313357-21kworker/u8:1+events_unbound20:40:432
3290471993123,4cyclictest0-21swapper/220:00:262
3290467993125,4cyclictest3363477-21munin-run22:40:001
3290467993123,4cyclictest0-21swapper/120:55:261
3290467993123,4cyclictest0-21swapper/120:55:261
3290467993121,5cyclictest0-21swapper/123:40:011
3290467993121,5cyclictest0-21swapper/100:40:001
3290467993119,8cyclictest3381977-21grep23:30:251
3290462993123,4cyclictest0-21swapper/021:40:010
3290462993122,6cyclictest0-21swapper/023:20:000
3290462993122,6cyclictest0-21swapper/023:20:000
3290462993121,6cyclictest0-21swapper/022:15:260
3290462993120,7cyclictest0-21swapper/023:05:010
3290462993115,13cyclictest11-21ksoftirqd/021:55:120
3290471993022,6cyclictest3321964-21kworker/u8:2+events_unbound20:50:452
3290471993022,6cyclictest3321964-21kworker/u8:2+events_unbound20:50:452
3290471993022,4cyclictest3343042-21sendmail21:40:012
3290471993022,4cyclictest0-21swapper/222:45:012
3290471993022,4cyclictest0-21swapper/220:10:002
3290471993022,4cyclictest0-21swapper/219:55:162
3290471993022,4cyclictest0-21swapper/219:55:162
3290471993019,7cyclictest3301435-21munin-run19:40:012
3290467993023,4cyclictest0-21swapper/119:40:011
3290467993020,7cyclictest3399460-21seq00:20:231
3290467993019,7cyclictest0-21swapper/120:05:251
3290467993016,9cyclictest3337555-21sshd21:20:551
3290462993021,6cyclictest0-21swapper/019:40:010
3290462993021,5cyclictest0-21swapper/019:15:030
3290462993019,6cyclictest0-21swapper/022:05:260
3290471992922,3cyclictest0-21swapper/222:20:242
3290471992922,3cyclictest0-21swapper/222:20:242
3290471992921,5cyclictest3363476-21sendmail22:40:012
3290471992921,4cyclictest0-21swapper/223:00:142
3290471992919,6cyclictest0-21swapper/200:40:012
3290467992923,3cyclictest0-21swapper/100:20:001
3290467992922,4cyclictest3387569-21idleruntime-cro23:50:001
3290467992920,6cyclictest0-21swapper/122:05:001
3290462992922,3cyclictest0-21swapper/021:40:240
3290462992921,5cyclictest0-21swapper/019:50:000
3290462992921,4cyclictest0-21swapper/022:30:250
329047199289,5cyclictest131rcu_preempt21:05:112
329047199286,12cyclictest32-21ksoftirqd/220:30:262
3290471992822,4cyclictest3351244-21kworker/u8:1+events_unbound22:17:422
3290471992822,4cyclictest3348004-21kworker/u8:2+events_unbound21:56:402
3290471992822,4cyclictest3304677-21kworker/u8:1+events_unbound19:50:332
3290471992819,6cyclictest0-21swapper/222:10:152
329047199281,3cyclictest0-21swapper/223:10:112
329047199281,3cyclictest0-21swapper/223:10:112
3290471992811,4cyclictest131rcu_preempt23:41:522
329047199281,13cyclictest0-21swapper/222:54:192
329047199281,12cyclictest0-21swapper/220:48:152
3290467992821,4cyclictest0-21swapper/100:10:241
3290467992819,6cyclictest3321658-21grep20:35:251
3290467992819,6cyclictest0-21swapper/122:15:261
3290462992820,5cyclictest0-21swapper/022:55:240
3290471992721,4cyclictest3325398-21kworker/u8:0+events_unbound21:01:542
3290471992720,5cyclictest3384107-21kworker/u8:0+events_unbound23:45:132
3290467992721,3cyclictest3386010-21latency_hist23:45:011
3290467992720,4cyclictest0-21swapper/122:45:271
3290467992719,5cyclictest0-21swapper/120:00:261
3290467992719,4cyclictest0-21swapper/100:10:001
3290462992720,5cyclictest3297799-21kworker/u8:3+events_unbound20:00:350
3290462992720,4cyclictest3340895-21head21:30:260
3290462992720,3cyclictest0-21swapper/020:10:250
329047199268,5cyclictest131rcu_preempt00:25:122
329047199265,14cyclictest32-21ksoftirqd/200:13:342
3290471992620,4cyclictest3369971-21kworker/u8:3+events_unbound23:16:162
3290471992620,4cyclictest3369971-21kworker/u8:3+events_unbound23:16:162
3290471992616,7cyclictest3402023-21tune2fs00:30:152
329047199261,12cyclictest0-21swapper/200:20:282
3290471992610,6cyclictest32-21ksoftirqd/220:55:262
3290471992610,6cyclictest32-21ksoftirqd/220:55:262
3290467992619,4cyclictest0-21swapper/123:00:231
3290467992618,4cyclictest0-21swapper/120:20:271
3290467992616,6cyclictest0-21swapper/121:45:171
3290467992616,6cyclictest0-21swapper/120:50:251
3290467992616,6cyclictest0-21swapper/120:50:251
3290462992620,4cyclictest13550irq/42-30be0000.ethernet21:16:390
3290462992618,5cyclictest164-21systemd-journal23:41:200
3290462992618,5cyclictest0-21swapper/021:45:170
3290462992615,6cyclictest3398235-21basename00:20:000
3290471992518,5cyclictest3301082-21kworker/u8:0+events_unbound19:40:122
3290471992518,4cyclictest311ktimers/220:23:062
3290471992516,7cyclictest3313357-21kworker/u8:1+events_unbound20:12:552
329047199251,21cyclictest3394729-21latency_hist00:10:002
3290467992519,3cyclictest0-21swapper/123:20:001
3290467992519,3cyclictest0-21swapper/123:20:001
3290467992519,3cyclictest0-21swapper/121:10:251
3290467992514,6cyclictest0-21swapper/119:15:251
3290462992519,4cyclictest3388959-21kworker/u8:0+events_unbound00:08:470
3290462992519,3cyclictest0-21swapper/022:35:260
3290462992518,4cyclictest3337477-21unixbench_singl21:20:270
3290462992518,4cyclictest11-21ksoftirqd/023:50:120
3290462992516,5cyclictest0-21swapper/022:48:090
329046299251,20cyclictest0-21swapper/022:21:380
329046299251,20cyclictest0-21swapper/022:21:370
3290471992418,4cyclictest3369971-21kworker/u8:3+events_unbound23:26:262
3290471992418,4cyclictest3309809-21kworker/u8:2+events_unbound20:27:062
3290471992417,5cyclictest3339237-21kworker/u8:2+events_unbound21:45:482
3290471992417,3cyclictest0-21swapper/222:25:142
3290467992414,6cyclictest3388860-21grep23:50:251
3290467992412,8cyclictest3392693-21cron00:05:001
329046799240,6cyclictest199-21systemd-network20:15:181
3290462992418,4cyclictest0-21swapper/019:50:130
3290462992417,3cyclictest0-21swapper/023:31:520
329047199236,6cyclictest32-21ksoftirqd/220:15:252
329047199233,6cyclictest3283993-21kworker/2:0-mm_percpu_wq22:58:322
3290471992317,4cyclictest3290457-21cyclictest19:25:022
3290467992317,3cyclictest0-21swapper/123:25:131
3290467992317,3cyclictest0-21swapper/122:30:161
3290467992316,4cyclictest0-21swapper/123:05:051
3290467992312,8cyclictest3304155-21ntp_states19:45:221
329046299231,9cyclictest3350579-21sed22:00:200
3290462992317,3cyclictest13550irq/42-30be0000.ethernet00:00:000
3290462992316,3cyclictest0-21swapper/022:10:240
3290462992316,3cyclictest0-21swapper/020:37:300
3290462992316,3cyclictest0-21swapper/020:05:200
3290462992315,5cyclictest0-21swapper/022:40:250
3290462992315,5cyclictest0-21swapper/020:30:250
3290462992314,5cyclictest0-21swapper/021:10:240
329046299231,18cyclictest0-21swapper/023:22:480
329046299231,18cyclictest0-21swapper/023:14:590
329046299231,18cyclictest0-21swapper/023:14:590
329046299231,18cyclictest0-21swapper/023:09:320
329046299230,19cyclictest0-21swapper/000:29:430
3290467992216,3cyclictest0-21swapper/100:30:231
3290467992215,5cyclictest3390737-21kworker/u8:2+events_unbound23:57:501
3290467992215,5cyclictest0-21swapper/119:40:011
3290467992215,4cyclictest3283143-21kworker/u8:2+events_unbound19:10:231
3290467992215,4cyclictest0-21swapper/119:25:261
3290467992213,6cyclictest3330794-21kworker/u8:1+events_unbound21:15:131
329046799221,17cyclictest3367126-21chrt22:50:131
3290462992216,4cyclictest0-21swapper/000:34:590
3290462992216,3cyclictest0-21swapper/019:55:160
3290462992216,3cyclictest0-21swapper/019:55:160
3290462992214,5cyclictest0-21swapper/020:25:150
3290462992213,6cyclictest0-21swapper/020:40:250
3290462992213,6cyclictest0-21swapper/020:20:160
3290462992212,7cyclictest3330419-21grep21:00:240
329046299221,17cyclictest0-21swapper/021:53:140
3290467992115,3cyclictest0-21swapper/121:50:221
3290467992112,6cyclictest0-21swapper/121:25:241
3290467992110,8cyclictest3312114-21apt-get20:10:131
3290467992014,3cyclictest0-21swapper/120:25:221
3290467992013,4cyclictest3400328-21fschecks_count00:25:151
329046799199,7cyclictest3358800-21cut22:25:151
3290467991812,4cyclictest3353603-21forks22:10:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional