You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-17 - 23:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Mon Aug 17, 2026 12:44:11)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
217242920,2sleep1281ktimers/112:20:041
217242920,2sleep1281ktimers/112:20:041
139912920,1sleep10-21swapper/110:34:081
59132890,2sleep15915-21latency_hist10:13:581
59132890,2sleep15915-21latency_hist10:13:581
153682790,2sleep10-21swapper/107:44:111
153682790,2sleep10-21swapper/107:44:111
307892740,3sleep10-21swapper/111:19:061
307892740,3sleep10-21swapper/111:19:061
298972640,3chrt0-21swapper/308:24:053
103022630,3sleep30-21swapper/311:49:153
103022630,3sleep30-21swapper/311:49:153
200982610,2chrt0-21swapper/107:58:551
60822590,2sleep16128-21fschecks_count10:14:071
12322590,5sleep11228-21apt-config09:59:141
12322590,5sleep11228-21apt-config09:59:141
177832460,2sleep117785-21latency10:44:091
177832460,2sleep117785-21latency10:44:091
23682450,3sleep10-21swapper/110:04:051
3485994315,5cyclictest271rcuc/109:22:271
3485994315,5cyclictest271rcuc/109:22:271
226372430,3chrt0-21swapper/110:58:521
226372430,3chrt0-21swapper/110:58:521
290302420,2sleep20-21swapper/211:14:102
290302420,2sleep20-21swapper/211:14:102
241092420,3sleep30-21swapper/312:28:593
241092420,3sleep30-21swapper/312:28:593
122432410,2chrt12242-21df_inode09:04:031
141122370,2sleep114115-21cpuspeed09:09:011
3485993528,5cyclictest14678-21systemd-journal09:33:511
201472350,3sleep20-21swapper/209:24:062
115542350,1sleep011592-21ntp_states07:34:100
51622340,2sleep15201-21idleruntime-cro11:38:531
51622340,2sleep15201-21idleruntime-cro11:38:531
348599337,6cyclictest281ktimers/112:08:241
3485993327,5cyclictest23144-21gltestperf10:59:041
3485993327,5cyclictest23144-21gltestperf10:59:041
3485993325,5cyclictest281ktimers/112:36:551
3485993325,5cyclictest281ktimers/112:36:551
3485993325,5cyclictest281ktimers/109:57:211
3485993312,5cyclictest271rcuc/112:24:541
3485993312,5cyclictest271rcuc/112:24:541
3478993326,5cyclictest13259-21latency_hist10:33:510
3478993326,5cyclictest13259-21latency_hist10:33:510
130302330,2sleep20-21swapper/209:04:122
3485993226,4cyclictest18302-21latency_hist12:13:521
3485993225,4cyclictest281ktimers/109:38:491
3485993224,6cyclictest545-21in:imuxsock09:49:041
3485993224,6cyclictest11257-21threads08:59:131
3485993224,6cyclictest11257-21threads08:59:131
3478993226,4cyclictest3477-21cyclictest07:54:050
3478993226,4cyclictest26902-21sendmail09:43:510
3478993226,4cyclictest26902-21sendmail09:43:510
348599317,4cyclictest271rcuc/108:09:471
3485993127,3cyclictest90-1pr/ttyS009:27:501
3485993125,5cyclictest29316-21mailstats11:14:141
3485993125,5cyclictest29316-21mailstats11:14:141
3485993123,5cyclictest281ktimers/110:42:211
3485993123,5cyclictest281ktimers/110:42:211
3485993122,3cyclictest181rcu_preempt08:32:211
3485993117,3cyclictest90-1pr/ttyS011:24:091
3485993117,3cyclictest90-1pr/ttyS011:24:091
3485993117,3cyclictest90-1pr/ttyS008:00:441
3485993117,3cyclictest90-1pr/ttyS008:00:441
3478993124,5cyclictest8643-21processes10:19:110
3478993124,5cyclictest8643-21processes10:19:110
3478993124,5cyclictest25364-21unixbench_singl12:29:160
3478993124,5cyclictest25364-21unixbench_singl12:29:160
3478993123,6cyclictest550-21cron11:48:510
202772310,2sleep120278-21latency_hist12:18:561
67752300,3chrt0-21swapper/210:14:152
348599309,9cyclictest29-21ksoftirqd/112:43:371
348599309,9cyclictest29-21ksoftirqd/112:43:371
348599309,4cyclictest281ktimers/110:22:361
348599309,4cyclictest281ktimers/110:22:361
3485993022,6cyclictest1354-21kernelversion08:34:061
348599301,5cyclictest700-21192.168.115.40-manager11:31:231
348599301,5cyclictest700-21192.168.115.40-manager11:31:231
348599299,17cyclictest281ktimers/108:42:481
348599299,17cyclictest281ktimers/108:42:481
3485992922,4cyclictest0-21swapper/110:29:041
3485992922,4cyclictest0-21swapper/110:29:041
3485992921,3cyclictest181rcu_preempt11:51:551
3485992921,3cyclictest181rcu_preempt11:51:551
3485992919,2cyclictest181rcu_preempt09:40:521
3485992919,2cyclictest181rcu_preempt09:40:521
3485992915,4cyclictest90-1pr/ttyS008:49:081
3485992913,4cyclictest181rcu_preempt10:24:091
3485992913,4cyclictest181rcu_preempt10:24:091
3478992923,4cyclictest3477-21cyclictest10:59:020
3478992923,4cyclictest3477-21cyclictest10:59:020
3478992923,3cyclictest0-21swapper/009:23:510
3478992923,3cyclictest0-21swapper/009:23:510
3478992912,4cyclictest90-1pr/ttyS012:22:540
3478992912,4cyclictest90-1pr/ttyS012:22:540
137312290,3sleep30-21swapper/310:34:063
348599288,8cyclictest29-21ksoftirqd/108:20:141
348599288,8cyclictest29-21ksoftirqd/108:20:141
348599283,5cyclictest281ktimers/111:58:241
348599283,5cyclictest281ktimers/111:58:241
3485992822,4cyclictest572-21cups-browsed07:34:121
3485992821,5cyclictest26049-21cut08:14:041
347899285,16cyclictest16-21ksoftirqd/009:04:030
3478992822,4cyclictest617-21lldpd10:09:050
3478992822,4cyclictest617-21lldpd10:09:050
3478992821,5cyclictest20316-21needreboot09:24:090
191072280,2sleep019207-21awk10:49:030
348599278,8cyclictest29-21ksoftirqd/111:47:451
3485992722,3cyclictest11649-21kworker/u9:2-xprtiod09:14:071
3485992722,3cyclictest11649-21kworker/u9:2-xprtiod09:14:071
3485992719,3cyclictest181rcu_preempt12:01:251
3485992719,3cyclictest181rcu_preempt12:01:251
3485992718,7cyclictest27389-21fschecks_time09:44:081
3485992718,7cyclictest27389-21fschecks_time09:44:081
348599271,6cyclictest271rcuc/110:53:271
3485992714,2cyclictest181rcu_preempt08:04:151
3485992713,4cyclictest90-1pr/ttyS012:33:521
3485992713,4cyclictest90-1pr/ttyS012:33:521
3478992722,4cyclictest3063-21gltestperf08:39:050
3478992722,4cyclictest3063-21gltestperf08:39:050
3478992722,3cyclictest0-21swapper/009:29:050
3478992721,4cyclictest28236-21timerwakeupswit09:44:180
3478992721,4cyclictest28236-21timerwakeupswit09:44:180
3478992720,5cyclictest11127-21systemctl08:59:110
3478992720,5cyclictest11127-21systemctl08:59:110
3478992718,7cyclictest12736-21latency_hist11:58:530
3478992718,7cyclictest12736-21latency_hist11:58:530
348599267,16cyclictest281ktimers/111:39:531
348599267,16cyclictest281ktimers/111:39:531
3485992619,5cyclictest31282-21latency_hist08:28:541
3485992618,5cyclictest281ktimers/111:11:361
3478992621,3cyclictest13874-21gltestperf10:34:070
3478992621,3cyclictest11399-21idleruntime-cro10:28:510
3478992621,3cyclictest11399-21idleruntime-cro10:28:510
3478992621,3cyclictest0-21swapper/011:04:120
3478992620,4cyclictest0-21swapper/010:54:050
3478992620,4cyclictest0-21swapper/010:54:050
3478992619,4cyclictest0-21swapper/008:44:150
3478992619,4cyclictest0-21swapper/008:44:150
3478992618,6cyclictest27543-21latency_hist08:18:540
3478992617,7cyclictest23244-21unixbench-2d08:04:150
3478992612,12cyclictest0-21swapper/009:49:030
3478992611,2cyclictest181rcu_preempt07:50:460
3478992611,2cyclictest181rcu_preempt07:50:460
3485992520,4cyclictest1-21systemd07:43:181
3485992520,4cyclictest1-21systemd07:43:181
3485992517,6cyclictest5548-21grep08:44:151
3485992517,6cyclictest5548-21grep08:44:151
3485992515,3cyclictest181rcu_preempt11:04:451
3485992514,2cyclictest181rcu_preempt07:49:141
3485992514,2cyclictest181rcu_preempt07:49:141
3485992510,2cyclictest181rcu_preempt08:54:121
3485992510,2cyclictest181rcu_preempt08:54:121
347899258,4cyclictest90-1pr/ttyS011:21:380
347899258,4cyclictest90-1pr/ttyS011:21:380
3478992519,4cyclictest0-21swapper/011:24:040
3478992519,4cyclictest0-21swapper/011:24:040
3478992518,5cyclictest17928-21needreboot10:44:110
3478992518,5cyclictest17928-21needreboot10:44:110
3478992512,11cyclictest90-1pr/ttyS007:44:490
3478992512,11cyclictest90-1pr/ttyS007:44:490
3478992510,9cyclictest90-1pr/ttyS008:49:090
3478992420,3cyclictest60-21kcompactd009:09:070
3478992420,2cyclictest0-21swapper/012:03:510
3478992420,2cyclictest0-21swapper/012:03:510
3478992417,5cyclictest16067-21fschecks_count09:14:060
3478992417,5cyclictest16067-21fschecks_count09:14:060
3478992417,5cyclictest0-21swapper/012:09:060
3478992416,6cyclictest3477-21cyclictest08:29:080
3478992415,8cyclictest90-1pr/ttyS007:43:550
3478992415,8cyclictest90-1pr/ttyS007:43:550
3478992415,7cyclictest23553-21fschecks_count09:34:040
3492992316,4cyclictest91242chrt11:48:582
347899238,7cyclictest31510-21needreboot09:54:070
347899237,10cyclictest181rcu_preempt08:34:060
3478992318,3cyclictest90-1pr/ttyS011:49:060
3478992318,3cyclictest90-1pr/ttyS011:49:060
3478992318,3cyclictest0-21swapper/011:14:140
3478992318,3cyclictest0-21swapper/011:14:140
3478992318,3cyclictest0-21swapper/010:43:520
3478992318,3cyclictest0-21swapper/010:43:520
3478992318,3cyclictest0-21swapper/008:09:050
3478992318,2cyclictest0-21swapper/007:59:040
3478992318,2cyclictest0-21swapper/007:59:040
3478992317,4cyclictest90-1pr/ttyS012:07:590
3478992317,4cyclictest60-21kcompactd011:09:070
3478992316,5cyclictest28664-21processes12:39:120
3478992316,5cyclictest28664-21processes12:39:120
3478992316,4cyclictest0-21swapper/011:29:080
3478992316,4cyclictest0-21swapper/011:29:080
3478992311,11cyclictest90-1pr/ttyS011:38:590
3478992311,11cyclictest90-1pr/ttyS011:38:590
347899230,14cyclictest16-21ksoftirqd/012:14:070
347899221,8cyclictest23775-21runrttasks12:27:090
347899221,8cyclictest23775-21runrttasks12:27:090
347899221,7cyclictest3926-21latency_hist10:08:530
3478992217,4cyclictest786-21kernelversion09:59:080
3478992217,4cyclictest786-21kernelversion09:59:080
3478992217,3cyclictest0-21swapper/010:18:510
3478992217,3cyclictest0-21swapper/008:24:030
3478992116,3cyclictest0-21swapper/012:34:040
3478992116,3cyclictest0-21swapper/012:34:040
3478992115,4cyclictest0-21swapper/008:19:040
3478992115,4cyclictest0-21swapper/008:19:040
25022210,4sleep20-21swapper/208:38:512
3478992014,3cyclictest0-21swapper/008:54:050
3478992014,3cyclictest0-21swapper/008:54:050
349299191,14cyclictest16582-21chrt07:49:032
349299191,14cyclictest16582-21chrt07:49:032
347899191,15cyclictest5398-21find11:39:010
347899191,15cyclictest5398-21find11:39:010
349299181,11cyclictest27332-21chrt09:44:082
349299181,11cyclictest27332-21chrt09:44:082
349899171,13cyclictest29222-21chrt09:49:033
349899171,12cyclictest21866-21chrt09:29:053
349899171,11cyclictest7834-21chrt10:19:023
349899171,11cyclictest7834-21chrt10:19:023
349299171,9cyclictest0-21swapper/208:14:022
349299171,12cyclictest3966-21chrt08:39:162
349299171,12cyclictest3966-21chrt08:39:162
349299171,12cyclictest22810-21chrt08:04:102
349299171,11cyclictest824-21chrt08:33:572
349299171,11cyclictest2550-21taskset10:04:062
349299171,10cyclictest32705-21chrt09:59:032
349299171,10cyclictest32705-21chrt09:59:032
349299170,13cyclictest15397-21chrt07:44:122
349299170,13cyclictest15397-21chrt07:44:122
349899163,9cyclictest0-21swapper/309:16:043
349899163,9cyclictest0-21swapper/309:16:043
349899163,11cyclictest15606-21chrt10:39:043
349899163,11cyclictest15606-21chrt10:39:043
349899161,9cyclictest31483-21taskset08:29:043
349899161,12cyclictest30100-21taskset11:18:523
349899161,12cyclictest30100-21taskset11:18:523
349899161,10cyclictest27765-21chrt12:38:563
349899161,10cyclictest27765-21chrt12:38:563
349899161,10cyclictest25206-21taskset09:38:583
349299163,6cyclictest0-21swapper/212:09:062
349299161,11cyclictest4677-21chrt10:09:082
349299161,11cyclictest4677-21chrt10:09:082
349299161,11cyclictest26433-21chrt11:08:542
349299161,11cyclictest23981-21chrt12:28:542
349299161,11cyclictest23981-21chrt12:28:542
349299161,11cyclictest10356-21taskset10:24:082
349299161,11cyclictest10356-21taskset10:24:082
349299161,11cyclictest0-21swapper/208:44:092
349299161,11cyclictest0-21swapper/208:44:092
349299161,10cyclictest26279-21taskset12:34:042
349299161,10cyclictest26279-21taskset12:34:042
349299161,10cyclictest23995-21chrt10:59:132
349299161,10cyclictest23995-21chrt10:59:132
292232161,2sleep20-21swapper/212:40:242
292232161,2sleep20-21swapper/212:40:242
349899159,4cyclictest142992sleep309:09:043
349899153,8cyclictest0-21swapper/308:05:433
349899151,12cyclictest3287-21taskset10:04:153
349899151,11cyclictest28870-21taskset08:19:153
349899151,11cyclictest28870-21taskset08:19:153
349899151,11cyclictest20285-21taskset09:24:073
349899151,10cyclictest0-21swapper/310:59:013
349899151,10cyclictest0-21swapper/310:59:013
349899151,10cyclictest0-21swapper/310:09:053
349899151,10cyclictest0-21swapper/310:09:053
349899151,10cyclictest0-21swapper/308:14:043
349299153,9cyclictest0-21swapper/211:35:042
349299153,9cyclictest0-21swapper/211:35:042
349299151,9cyclictest23245-21chrt09:33:552
349299151,9cyclictest0-21swapper/207:39:022
349299151,9cyclictest0-21swapper/207:39:022
349299151,7cyclictest0-21swapper/210:34:042
349299151,11cyclictest8229-21taskset10:19:052
349299151,11cyclictest8229-21taskset10:19:052
349299151,11cyclictest30891-21chrt11:19:072
349299151,11cyclictest30891-21chrt11:19:072
349299151,10cyclictest24460-21chrt12:29:062
349299151,10cyclictest24460-21chrt12:29:062
349299151,10cyclictest20856-21chrt07:59:082
349299151,10cyclictest20856-21chrt07:59:082
349299151,10cyclictest15953-21chrt10:39:072
349299151,10cyclictest15953-21chrt10:39:072
349299151,10cyclictest11206-21chrt11:54:042
349299151,10cyclictest11206-21chrt11:54:042
349299151,10cyclictest10733-21chrt08:59:052
349299151,10cyclictest10733-21chrt08:59:052
349299151,10cyclictest0-21swapper/208:19:032
349299151,10cyclictest0-21swapper/208:19:032
349299150,11cyclictest17875-21taskset09:19:032
349299150,11cyclictest17875-21taskset09:19:032
349899149,3cyclictest144562chrt12:02:423
349899149,3cyclictest144562chrt12:02:423
349899148,4cyclictest180372chrt09:19:043
349899148,4cyclictest180372chrt09:19:043
349899141,11cyclictest860-21taskset09:59:083
349899141,11cyclictest860-21taskset09:59:083
349899141,11cyclictest2920-21taskset08:39:053
349899141,11cyclictest2920-21taskset08:39:053
349899141,11cyclictest21497-21chrt12:19:143
349899141,11cyclictest21497-21chrt12:19:143
349899141,11cyclictest20873-21taskset07:59:093
349899141,11cyclictest20873-21taskset07:59:093
349899141,10cyclictest7500-21chrt11:44:043
349899141,10cyclictest6135-21taskset11:39:103
349899141,10cyclictest6135-21taskset11:39:103
349899141,10cyclictest32324-21chrt11:24:023
349899141,10cyclictest32324-21chrt11:24:023
349899141,10cyclictest30969-21chrt09:54:023
349899141,10cyclictest15802-21chrt12:04:143
349899141,10cyclictest0-21swapper/307:54:063
349299149,3cyclictest101732sleep211:49:152
349299149,3cyclictest101732sleep211:49:152
349299143,9cyclictest0-21swapper/212:19:562
349299143,9cyclictest0-21swapper/212:19:562
349299141,9cyclictest29087-21taskset09:49:022
349299141,9cyclictest1738-21chrt11:29:042
349299141,9cyclictest1738-21chrt11:29:042
349299141,9cyclictest14872-21chrt09:09:112
349299141,10cyclictest27708-21taskset11:09:142
349299141,10cyclictest23478-21chrt09:34:032
349299141,10cyclictest0-21swapper/210:49:072
78292131,2sleep20-21swapper/208:49:542
349899139,2cyclictest0-21swapper/312:43:503
349899139,2cyclictest0-21swapper/312:43:503
349899138,3cyclictest62562chrt08:48:373
349899138,3cyclictest62562chrt08:48:373
349899138,3cyclictest32532chrt11:33:393
349899138,3cyclictest32532chrt11:33:393
349899138,3cyclictest319412chrt11:23:503
349899138,3cyclictest319412chrt11:23:503
349899138,3cyclictest286632sleep309:47:443
349899138,3cyclictest286632sleep309:47:443
349899138,3cyclictest261002chrt11:05:373
349899138,3cyclictest23992chrt08:37:363
349899138,3cyclictest158972chrt07:44:173
349899138,3cyclictest158972chrt07:44:173
349899138,3cyclictest124522chrt11:56:103
349899138,3cyclictest124522chrt11:56:103
349899132,8cyclictest0-21swapper/312:09:033
349899131,9cyclictest27840-21taskset11:09:153
349899131,9cyclictest13146-21chrt09:04:133
349899131,8cyclictest0-21swapper/312:29:143
349899131,8cyclictest0-21swapper/312:29:143
349899131,8cyclictest0-21swapper/310:29:043
349899131,8cyclictest0-21swapper/310:29:043
349899131,10cyclictest25232-21taskset09:39:023
349899131,10cyclictest25232-21taskset09:39:023
349899131,10cyclictest17312-21chrt07:49:123
349899131,10cyclictest17312-21chrt07:49:123
349899131,10cyclictest12813-21chrt07:39:033
349899131,10cyclictest12813-21chrt07:39:033
349899131,10cyclictest12167-21chrt07:34:493
349899131,10cyclictest10355-21chrt08:59:023
349899131,10cyclictest10355-21chrt08:59:023
349299138,3cyclictest297272chrt08:24:042
349299138,3cyclictest130572chrt10:31:232
349299138,3cyclictest130572chrt10:31:232
349299131,9cyclictest25313-21chrt08:10:252
349299131,8cyclictest8468-21taskset08:54:032
349299131,8cyclictest8468-21taskset08:54:032
349299131,8cyclictest5816-21chrt11:39:052
349299131,8cyclictest5816-21chrt11:39:052
349299131,8cyclictest19009-21chrt07:54:092
349299131,8cyclictest10842-21taskset07:33:592
349299131,10cyclictest18990-21chrt12:14:062
349299130,9cyclictest16001-21chrt09:14:052
349299130,9cyclictest16001-21chrt09:14:052
187742131,2sleep30-21swapper/310:47:293
187742131,2sleep30-21swapper/310:47:293
349899128,2cyclictest0-21swapper/311:34:203
349899128,2cyclictest0-21swapper/311:34:203
349899121,9cyclictest6705-21chrt08:49:063
349899121,9cyclictest25391-21chrt08:11:273
349899121,9cyclictest19392-21chrt10:49:053
349899121,9cyclictest18624-21chrt12:14:033
349899121,9cyclictest10000-21chrt10:24:053
349899121,9cyclictest10000-21chrt10:24:053
349899121,8cyclictest8506-21chrt08:54:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional