You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-02 - 05:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Thu Jul 02, 2026 00:44:20)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
572921220,4sleep20-21swapper/221:28:232
572921220,4sleep20-21swapper/221:28:232
786021170,3sleep20-21swapper/220:08:192
786021170,3sleep20-21swapper/220:08:192
1972621010,3sleep20-21swapper/223:33:172
1972621010,3sleep20-21swapper/223:33:172
255112990,3chrt0-21swapper/222:20:212
255112990,3chrt0-21swapper/222:20:212
202002980,3sleep30-21swapper/320:38:313
202002980,3sleep30-21swapper/320:38:313
202002980,3sleep30-21swapper/320:38:313
154042850,2sleep30-21swapper/323:18:313
154042850,2sleep30-21swapper/323:18:313
154042850,2sleep30-21swapper/323:18:313
36552820,3chrt0-21swapper/121:23:201
36552820,3chrt0-21swapper/121:23:201
36552820,3chrt0-21swapper/121:23:201
273412700,2chrt27340-21tune2fs19:33:211
150642700,2chrt15066-21awk23:18:291
150642700,2chrt15066-21awk23:18:291
150642700,2chrt15066-21awk23:18:291
77722690,2chrt0-21swapper/000:28:110
77722690,2chrt0-21swapper/000:28:110
77722690,2chrt0-21swapper/000:28:110
322962690,3chrt0-21swapper/100:03:441
322962690,3chrt0-21swapper/100:03:441
322962690,3chrt0-21swapper/100:03:441
280512690,3chrt0-21swapper/322:28:223
280512690,3chrt0-21swapper/322:28:223
272162680,2chrt27219-21unixbench_singl22:23:330
272162680,2chrt27219-21unixbench_singl22:23:330
272162680,2chrt27219-21unixbench_singl22:23:330
257742670,2sleep125731-21latency_hist22:23:091
257742670,2sleep125731-21latency_hist22:23:091
214002650,1chrt0-21swapper/120:43:241
214002650,1chrt0-21swapper/120:43:241
214002650,1chrt0-21swapper/120:43:241
181932620,3chrt0-21swapper/120:33:311
181932620,3chrt0-21swapper/120:33:311
29692600,3chrt0-21swapper/322:48:203
29692600,3chrt0-21swapper/322:48:203
255332570,3chrt0-21swapper/223:48:212
255332570,3chrt0-21swapper/223:48:212
71342550,8chrt281ktimers/122:58:231
71342550,8chrt281ktimers/122:58:231
71342550,8chrt281ktimers/122:58:231
65782550,3sleep30-21swapper/320:03:263
65782550,3sleep30-21swapper/320:03:263
65782550,3sleep30-21swapper/320:03:263
65782550,3sleep30-21swapper/320:03:263
322732550,4chrt0-21swapper/322:38:273
322732550,4chrt0-21swapper/322:38:273
311262540,3sleep10-21swapper/119:43:221
311262540,3sleep10-21swapper/119:43:221
311262540,3sleep10-21swapper/119:43:221
280492500,2chrt0-21swapper/323:53:283
280492500,2chrt0-21swapper/323:53:283
52962490,1sleep05298-21date21:28:170
52962490,1sleep05298-21date21:28:170
247502490,3sleep30-21swapper/322:18:253
247502490,3sleep30-21swapper/322:18:253
300372480,2sleep10-21swapper/119:38:321
259472480,3sleep30-21swapper/320:53:433
259472480,3sleep30-21swapper/320:53:433
165382470,2sleep20-21swapper/221:58:182
165382470,2sleep20-21swapper/221:58:182
165382470,2sleep20-21swapper/221:58:182
120742470,4sleep20-21swapper/221:43:312
120742470,4sleep20-21swapper/221:43:312
120742470,4sleep20-21swapper/221:43:312
19905994626,18cyclictest772-21latency_hist22:43:090
19905994626,18cyclictest772-21latency_hist22:43:090
19905994419,23cyclictest13208-21head21:48:230
19905994419,23cyclictest13208-21head21:48:230
308852430,4chrt30816-40mandb00:03:151
308852430,4chrt30816-40mandb00:03:151
308852430,4chrt30816-40mandb00:03:151
244672420,2sleep024569-21irqstats22:18:230
244672420,2sleep024569-21irqstats22:18:230
19905994221,19cyclictest0-21swapper/000:23:090
19905994221,19cyclictest0-21swapper/000:23:090
19905994221,19cyclictest0-21swapper/000:23:090
19905994214,26cyclictest19116-21missed_timers22:03:240
19905994214,26cyclictest19116-21missed_timers22:03:240
65732410,3sleep30-21swapper/321:28:323
65732410,3sleep30-21swapper/321:28:323
297572410,2sleep30-21swapper/319:38:303
124482410,2sleep012493-21proc_pri00:38:290
124482410,2sleep012493-21proc_pri00:38:290
103382410,3chrt0-21swapper/220:13:262
103382410,3chrt0-21swapper/220:13:262
38202400,2sleep10-21swapper/122:48:301
38202400,2sleep10-21swapper/122:48:301
38202400,2sleep10-21swapper/122:48:301
314352400,3sleep20-21swapper/222:38:142
314352400,3sleep20-21swapper/222:38:142
19905994013,25cyclictest0-21swapper/020:53:240
19905994013,25cyclictest0-21swapper/020:53:240
1990599391,7cyclictest11615-21latency_hist00:38:160
1990599391,7cyclictest11615-21latency_hist00:38:160
19905993912,3cyclictest700-21192.168.115.40-manager19:29:030
19905993912,3cyclictest700-21192.168.115.40-manager19:29:030
54592380,4sleep20-21swapper/200:18:322
54592380,4sleep20-21swapper/200:18:322
54592380,4sleep20-21swapper/200:18:322
1990599384,7cyclictest674-21gpm00:15:110
1990599384,7cyclictest674-21gpm00:15:110
1990599384,7cyclictest674-21gpm00:15:110
1990599381,18cyclictest30873-21sed00:03:140
1990599381,18cyclictest30873-21sed00:03:140
1990599381,18cyclictest30873-21sed00:03:140
19906993730,5cyclictest24231-21netstat23:43:261
19906993730,5cyclictest24231-21netstat23:43:261
19906993730,5cyclictest24231-21netstat23:43:261
1990599379,7cyclictest24194-21head23:43:250
1990599379,7cyclictest24194-21head23:43:250
1990599379,7cyclictest24194-21head23:43:250
1990599372,11cyclictest749-21runrttasks22:58:460
1990599372,11cyclictest749-21runrttasks22:58:460
1990599372,11cyclictest749-21runrttasks22:58:460
19905993712,3cyclictest0-21swapper/019:18:210
19905993712,3cyclictest0-21swapper/019:18:210
19905993712,3cyclictest0-21swapper/019:18:210
1990599371,12cyclictest10046-21sort20:13:220
1990599371,12cyclictest10046-21sort20:13:220
19905993710,3cyclictest0-21swapper/021:13:210
19905993710,3cyclictest0-21swapper/021:13:210
19905993710,3cyclictest0-21swapper/021:13:210
79772360,1sleep18032-21/usr/sbin/munin21:33:301
79772360,1sleep18032-21/usr/sbin/munin21:33:301
79772360,1sleep18032-21/usr/sbin/munin21:33:301
1991499362,28cyclictest32308-21chrt00:03:543
1991499362,28cyclictest32308-21chrt00:03:543
1991499362,28cyclictest32308-21chrt00:03:543
19906993627,7cyclictest5430-21needreboot22:53:281
19906993627,7cyclictest5430-21needreboot22:53:281
1990599364,11cyclictest27778-21expr23:53:230
1990599364,11cyclictest27778-21expr23:53:230
19905993613,2cyclictest0-21swapper/022:33:220
19905993613,2cyclictest0-21swapper/022:33:220
19905993612,3cyclictest0-21swapper/023:23:090
19905993612,3cyclictest0-21swapper/023:23:090
19905993612,3cyclictest0-21swapper/023:23:090
19905993612,3cyclictest0-21swapper/022:13:300
19905993612,3cyclictest0-21swapper/022:13:300
1990599361,13cyclictest32268-21users00:03:330
1990599361,13cyclictest32268-21users00:03:330
1990599361,13cyclictest32268-21users00:03:330
1990599361,12cyclictest26641-21grep23:48:320
1990599361,12cyclictest26641-21grep23:48:320
1990599361,12cyclictest26641-21grep23:48:320
19905993610,4cyclictest0-21swapper/019:53:250
19905993610,4cyclictest0-21swapper/019:53:250
290702350,3sleep10-21swapper/121:03:261
290702350,3sleep10-21swapper/121:03:261
235042350,3sleep20-21swapper/220:48:272
235042350,3sleep20-21swapper/220:48:272
235042350,3sleep20-21swapper/220:48:272
19906993528,5cyclictest20279-21kernelversion23:33:241
19906993528,5cyclictest20279-21kernelversion23:33:241
19905993511,3cyclictest0-21swapper/020:03:230
19905993511,3cyclictest0-21swapper/020:03:230
19905993511,3cyclictest0-21swapper/020:03:230
19905993511,3cyclictest0-21swapper/020:03:230
1990599351,12cyclictest6096-21awk21:28:280
1990599351,12cyclictest6096-21awk21:28:280
1990599351,12cyclictest3607-21ntp_kernel_pll_22:48:270
1990599351,12cyclictest3607-21ntp_kernel_pll_22:48:270
1990599351,12cyclictest3607-21ntp_kernel_pll_22:48:270
1990599351,12cyclictest2173-21memory21:18:260
1990599351,12cyclictest2173-21memory21:18:260
1990599351,12cyclictest2173-21memory21:18:260
1990599351,11cyclictest22780-21/usr/sbin/munin20:48:290
1990599351,11cyclictest22780-21/usr/sbin/munin20:48:290
1990599351,11cyclictest22780-21/usr/sbin/munin20:48:290
1990599351,11cyclictest14606-21grep20:23:300
1990599351,11cyclictest14606-21grep20:23:300
1990599351,11cyclictest13173-21cron20:23:090
1990599351,11cyclictest13173-21cron20:23:090
1990599351,11cyclictest13173-21cron20:23:090
1990599342,12cyclictest29374-21switchtime21:03:310
1990599342,12cyclictest29374-21switchtime21:03:310
19905993411,2cyclictest0-21swapper/023:28:210
19905993411,2cyclictest0-21swapper/023:28:210
19905993411,2cyclictest0-21swapper/023:28:210
223052330,7sleep1281ktimers/122:13:211
223052330,7sleep1281ktimers/122:13:211
1990899331,24cyclictest30903-21chrt00:03:162
1990899331,24cyclictest30903-21chrt00:03:162
1990899331,24cyclictest30903-21chrt00:03:162
19906993326,5cyclictest798-21sendmail22:43:091
19906993326,5cyclictest798-21sendmail22:43:091
1990599331,11cyclictest32001-21sed19:43:310
1990599331,11cyclictest32001-21sed19:43:310
1990599331,11cyclictest32001-21sed19:43:310
19905993310,3cyclictest0-21swapper/021:58:240
19905993310,3cyclictest0-21swapper/021:58:240
1991499321,25cyclictest30916-21chrt00:03:173
1991499321,25cyclictest30916-21chrt00:03:173
1991499321,25cyclictest30916-21chrt00:03:173
19906993225,5cyclictest24357-21gltestperf22:18:221
1990599321,12cyclictest25012-21latency_hist19:28:100
1990599321,12cyclictest25012-21latency_hist19:28:100
19906993126,3cyclictest10904-21kernelversion23:08:251
19906993126,3cyclictest10904-21kernelversion23:08:251
19906993125,5cyclictest23290-21kernelversion20:48:251
19906993125,5cyclictest23290-21kernelversion20:48:251
19906993125,5cyclictest23290-21kernelversion20:48:251
11562310,3sleep30-21swapper/300:08:323
11562310,3sleep30-21swapper/300:08:323
80332300,2sleep20-21swapper/200:28:212
80332300,2sleep20-21swapper/200:28:212
296112300,4sleep20-21swapper/222:33:162
296112300,4sleep20-21swapper/222:33:162
19906993026,3cyclictest4213-21ntp_offset21:23:261
19906993026,3cyclictest4213-21ntp_offset21:23:261
19906993023,5cyclictest2396-21fschecks_time19:53:231
19906993023,5cyclictest2396-21fschecks_time19:53:231
19906993022,6cyclictest2558-21fschecks_time00:13:241
19906993022,6cyclictest2558-21fschecks_time00:13:241
19906993022,6cyclictest2558-21fschecks_time00:13:241
19906993022,6cyclictest17931-21ls23:28:201
19906993022,6cyclictest17931-21ls23:28:201
19906993022,6cyclictest17931-21ls23:28:201
19905993024,3cyclictest0-21swapper/019:38:300
92902290,1sleep19316-21/usr/sbin/munin23:03:311
92902290,1sleep19316-21/usr/sbin/munin23:03:311
92902290,1sleep19316-21/usr/sbin/munin23:03:311
19906992923,3cyclictest0-21swapper/119:23:191
19906992923,3cyclictest0-21swapper/119:23:191
19906992923,3cyclictest0-21swapper/119:23:191
19906992920,6cyclictest30727-21ls22:33:311
19906992920,6cyclictest30727-21ls22:33:311
19905992918,3cyclictest0-21swapper/021:38:320
19905992918,3cyclictest0-21swapper/021:38:320
19906992823,3cyclictest0-21swapper/121:13:091
19906992823,3cyclictest0-21swapper/121:13:091
19906992823,3cyclictest0-21swapper/121:13:091
19906992822,5cyclictest28882-21cron23:58:091
19906992822,5cyclictest28882-21cron23:58:091
19906992822,4cyclictest7354-21vmstat00:23:341
19906992822,4cyclictest7354-21vmstat00:23:341
19906992822,4cyclictest7354-21vmstat00:23:341
19906992820,6cyclictest749-21runrttasks23:53:191
19906992820,6cyclictest749-21runrttasks23:53:191
19906992820,6cyclictest749-21runrttasks23:53:191
19906992819,7cyclictest21852-21fschecks_time23:38:231
19906992819,7cyclictest21852-21fschecks_time23:38:231
19905992822,4cyclictest15644-21gltestperf20:28:230
19905992822,4cyclictest15644-21gltestperf20:28:230
19905992821,5cyclictest21112-21sshd23:34:120
19905992821,5cyclictest21112-21sshd23:34:120
19906992720,5cyclictest6374-21threads21:28:311
19906992720,5cyclictest6374-21threads21:28:311
19906992718,7cyclictest10788-21sendmail21:43:091
19906992718,7cyclictest10788-21sendmail21:43:091
24192260,4chrt0-21swapper/221:18:302
24192260,4chrt0-21swapper/221:18:302
24192260,4chrt0-21swapper/221:18:302
221892260,2chrt0-21swapper/220:43:332
221892260,2chrt0-21swapper/220:43:332
221892260,2chrt0-21swapper/220:43:332
19906992622,2cyclictest0-21swapper/122:23:311
19906992622,2cyclictest0-21swapper/122:23:311
19906992622,2cyclictest0-21swapper/122:23:311
19906992622,2cyclictest0-21swapper/100:33:311
19906992622,2cyclictest0-21swapper/100:33:311
19906992619,5cyclictest13734-21processes21:48:291
19906992619,5cyclictest13734-21processes21:48:291
19906992618,6cyclictest25797-21ls19:28:251
19906992618,6cyclictest25797-21ls19:28:251
19905992622,2cyclictest0-21swapper/021:38:230
19905992620,5cyclictest6094-21sshd22:54:050
19905992620,5cyclictest6094-21sshd22:54:050
19905992619,5cyclictest0-21swapper/021:58:190
19905992619,5cyclictest0-21swapper/021:58:190
19905992619,5cyclictest0-21swapper/021:58:190
19905992613,11cyclictest0-21swapper/023:03:230
19905992613,11cyclictest0-21swapper/023:03:230
19905992613,11cyclictest0-21swapper/023:03:230
319122250,2sleep20-21swapper/219:43:312
319122250,2sleep20-21swapper/219:43:312
319122250,2sleep20-21swapper/219:43:312
19906992520,4cyclictest18727-21fschecks_time22:03:201
19906992520,4cyclictest18727-21fschecks_time22:03:201
19906992520,3cyclictest0-21swapper/121:53:311
19906992520,3cyclictest0-21swapper/121:53:311
19906992520,3cyclictest0-21swapper/121:53:311
19906992519,4cyclictest26827-21gltestperf20:58:221
19906992519,4cyclictest26827-21gltestperf20:58:221
19906992519,4cyclictest26827-21gltestperf20:58:221
19906992519,3cyclictest0-21swapper/120:23:091
19906992519,3cyclictest0-21swapper/120:23:091
19906992519,3cyclictest0-21swapper/120:23:091
19906992518,5cyclictest19903-21cyclictest20:42:261
19906992518,5cyclictest19903-21cyclictest20:42:261
19906992518,5cyclictest19903-21cyclictest20:42:261
19906992517,6cyclictest1528-21sort00:08:361
19906992517,6cyclictest1528-21sort00:08:361
19905992521,2cyclictest0-21swapper/020:33:200
19905992521,2cyclictest0-21swapper/020:33:200
19905992521,2cyclictest0-21swapper/020:08:290
19905992521,2cyclictest0-21swapper/020:08:290
19905992521,2cyclictest0-21swapper/020:08:290
19905992520,4cyclictest11251-21fschecks_time21:43:220
19905992520,4cyclictest11251-21fschecks_time21:43:220
19905992520,4cyclictest11251-21fschecks_time21:43:220
19905992519,5cyclictest5197-21unixbench-2d19:58:320
19905992519,5cyclictest5197-21unixbench-2d19:58:320
19905992517,6cyclictest550-21cron21:38:110
19905992517,6cyclictest550-21cron21:38:110
19905992515,7cyclictest2266-21latency_hist00:13:200
19905992515,7cyclictest2266-21latency_hist00:13:200
19905992514,9cyclictest14678-21systemd-journal22:13:090
19905992514,9cyclictest14678-21systemd-journal22:13:090
19906992420,2cyclictest0-21swapper/122:03:231
19906992420,2cyclictest0-21swapper/122:03:231
19906992420,2cyclictest0-21swapper/120:23:211
19906992420,2cyclictest0-21swapper/120:23:211
19906992419,4cyclictest8538-21missed_timers00:28:261
19906992419,4cyclictest8538-21missed_timers00:28:261
19906992419,3cyclictest0-21swapper/123:18:191
19906992419,3cyclictest0-21swapper/123:18:191
19906992418,4cyclictest981-21netstat19:48:281
19906992418,4cyclictest981-21netstat19:48:281
19906992418,4cyclictest981-21netstat19:48:281
19906992418,4cyclictest17001-21latency_hist20:33:101
19906992418,4cyclictest17001-21latency_hist20:33:101
19906992418,4cyclictest0-21swapper/122:13:291
19906992418,4cyclictest0-21swapper/120:13:311
19906992418,4cyclictest0-21swapper/120:13:311
19906992415,7cyclictest24365-21sort19:23:301
19906992415,7cyclictest24365-21sort19:23:301
19905992418,3cyclictest0-21swapper/023:13:220
87362230,3sleep30-21swapper/323:03:243
87362230,3sleep30-21swapper/323:03:243
87362230,3sleep30-21swapper/323:03:243
270182230,2chrt0-21swapper/220:58:242
270182230,2chrt0-21swapper/220:58:242
270182230,2chrt0-21swapper/220:58:242
1990899231,19cyclictest277772sleep223:53:232
1990899231,19cyclictest277772sleep223:53:232
19906992319,2cyclictest0-21swapper/100:23:091
19906992319,2cyclictest0-21swapper/100:23:091
19906992319,2cyclictest0-21swapper/100:23:091
19906992318,3cyclictest0-21swapper/120:58:191
19906992318,3cyclictest0-21swapper/120:58:191
19906992318,3cyclictest0-21swapper/119:58:321
19906992318,3cyclictest0-21swapper/119:58:321
19906992317,3cyclictest0-21swapper/121:43:221
19906992317,3cyclictest0-21swapper/121:43:221
19906992317,3cyclictest0-21swapper/121:43:221
19905992319,2cyclictest0-21swapper/020:43:230
19905992319,2cyclictest0-21swapper/020:43:230
19905992319,2cyclictest0-21swapper/020:43:230
19905992318,4cyclictest1648-21ntpd00:28:290
19905992318,4cyclictest1648-21ntpd00:28:290
19905992318,3cyclictest28403-21latency_hist21:03:200
19905992318,3cyclictest28403-21latency_hist21:03:200
19905992318,3cyclictest0-21swapper/023:08:300
19905992317,5cyclictest27428-21gltestperf19:33:220
19905992312,2cyclictest0-21swapper/023:13:260
19905992312,2cyclictest0-21swapper/023:13:260
19914992216,4cyclictest173362sleep320:33:213
19914992216,4cyclictest173362sleep320:33:213
19905992217,3cyclictest0-21swapper/020:38:220
19905992217,3cyclictest0-21swapper/020:38:220
19905992217,3cyclictest0-21swapper/020:38:220
20172210,2sleep016-21ksoftirqd/022:43:310
20172210,2sleep016-21ksoftirqd/022:43:310
19906992117,2cyclictest0-21swapper/122:43:251
19906992117,2cyclictest0-21swapper/122:43:251
19906992117,2cyclictest0-21swapper/120:08:301
19906992117,2cyclictest0-21swapper/120:08:301
19906992117,2cyclictest0-21swapper/120:08:301
19906992113,6cyclictest12751-21ls00:38:311
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional