You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-22 - 01:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Sun Dec 21, 2025 12:44:11)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1487421270,2sleep3431rcuc/311:05:233
1487421270,2sleep3431rcuc/311:05:233
1140021130,1chrt11399-21memory10:55:241
1140021130,1chrt11399-21memory10:55:241
3224721020,3sleep0201rcuc/007:30:320
3224721020,3sleep0201rcuc/007:30:320
228832990,3sleep00-21swapper/011:25:300
228832990,3sleep00-21swapper/011:25:300
150242940,7sleep015023-21ethtool11:05:240
150242940,7sleep015023-21ethtool11:05:240
48072910,3sleep00-21swapper/012:05:220
48072910,3sleep00-21swapper/012:05:220
81142890,3chrt0-21swapper/212:15:092
65152750,5chrt6517-21fschecks_count07:50:220
65152750,5chrt6517-21fschecks_count07:50:220
185042690,3chrt0-21swapper/308:20:323
185042690,3chrt0-21swapper/308:20:323
55692640,4chrt5568-21switchtime12:05:311
55692640,4chrt5568-21switchtime12:05:311
176512630,3chrt0-21swapper/011:10:310
176512630,3chrt0-21swapper/011:10:310
312882580,3sleep30-21swapper/308:55:263
312882580,3sleep30-21swapper/308:55:263
187582580,2sleep00-21swapper/009:50:140
187582580,2sleep00-21swapper/009:50:140
39652520,3sleep30-21swapper/310:35:243
39652520,3sleep30-21swapper/310:35:243
45902460,2sleep04665-21fschecks_count07:45:240
45902460,2sleep04665-21fschecks_count07:45:240
171802460,3chrt0-21swapper/309:45:233
171802460,3chrt0-21swapper/309:45:233
42572450,1chrt0-21swapper/009:10:220
213962450,2sleep30-21swapper/308:30:213
252092390,3sleep30-21swapper/308:40:223
252092390,3sleep30-21swapper/308:40:223
23752993728,7cyclictest30821-21netstat10:20:270
23752993728,7cyclictest30821-21netstat10:20:270
40682360,3sleep30-21swapper/309:10:213
176572360,2sleep30-21swapper/312:40:193
176572360,2sleep30-21swapper/312:40:193
103312360,3sleep30-21swapper/312:20:213
103312360,3sleep30-21swapper/312:20:213
9492350,4sleep0171ktimers/011:55:210
9492350,4sleep0171ktimers/011:55:210
23752993523,5cyclictest15467-21awk08:15:090
23752993523,5cyclictest15467-21awk08:15:090
236392350,3chrt0-21swapper/308:35:233
236392350,3chrt0-21swapper/308:35:233
236392350,3chrt0-21swapper/308:35:233
232612350,2sleep00-21swapper/008:35:210
232612350,2sleep00-21swapper/008:35:210
232612350,2sleep00-21swapper/008:35:210
166292350,2sleep016757-21sensors12:35:300
166292350,2sleep016757-21sensors12:35:300
292692340,2sleep129292-21grep07:25:151
292692340,2sleep129292-21grep07:25:151
25012340,2sleep20-21swapper/210:30:322
25012340,2sleep20-21swapper/210:30:322
142412340,1sleep00-21swapper/012:30:240
142412340,1sleep00-21swapper/012:30:240
23753993327,5cyclictest31727-21kernelversion07:30:251
23753993327,5cyclictest31727-21kernelversion07:30:251
23752993326,5cyclictest11315-21timerwakeupswit12:20:320
23752993326,5cyclictest11315-21timerwakeupswit12:20:320
23752993326,5cyclictest11315-21timerwakeupswit12:20:320
152352330,3sleep30-21swapper/312:30:343
152352330,3sleep30-21swapper/312:30:343
23753993225,5cyclictest142-21systemd-journal07:45:091
23753993225,5cyclictest142-21systemd-journal07:45:091
23753993225,5cyclictest13772-21latency_hist08:10:161
23753993225,5cyclictest13772-21latency_hist08:10:161
23753993223,7cyclictest32137-21fschecks_count10:25:221
23753993223,7cyclictest32137-21fschecks_count10:25:221
23752993228,3cyclictest15998-21gltestperf08:15:230
23752993228,3cyclictest15998-21gltestperf08:15:230
23752993228,3cyclictest15998-21gltestperf08:15:230
23752993225,6cyclictest6788-21sshd10:44:170
23752993225,6cyclictest6788-21sshd10:44:170
23753993124,5cyclictest29442-21needreboot08:50:271
23753993124,5cyclictest29442-21needreboot08:50:271
23753993124,5cyclictest28968-21ntp_offset10:15:301
23753993124,5cyclictest28968-21ntp_offset10:15:301
23753993124,5cyclictest15004-21timerandwakeup12:30:321
23753993124,5cyclictest15004-21timerandwakeup12:30:321
23753993122,7cyclictest20098-21needreboot08:25:241
23752993124,5cyclictest26919-21latency10:10:250
23752993124,5cyclictest20435-21threads08:25:280
52132300,4sleep30-21swapper/307:45:303
52132300,4sleep30-21swapper/307:45:303
272462300,3sleep20-21swapper/208:45:232
272462300,3sleep20-21swapper/208:45:232
23753993026,2cyclictest0-21swapper/108:00:091
23753993026,2cyclictest0-21swapper/108:00:091
23753993026,2cyclictest0-21swapper/108:00:091
23753993025,4cyclictest749-21runrttasks10:00:311
23753993023,5cyclictest11320-21latency_hist09:30:141
23753993023,5cyclictest11320-21latency_hist09:30:141
23753993014,13cyclictest25538-21cron11:35:091
23753993014,13cyclictest25538-21cron11:35:091
23752993025,4cyclictest23751-21cyclictest08:20:290
23752993025,4cyclictest23751-21cyclictest08:20:290
23752993023,5cyclictest9749-21cut09:25:210
23752993023,5cyclictest9749-21cut09:25:210
23752993023,5cyclictest13917-21latency_hist12:30:170
127652300,3sleep20-21swapper/212:25:262
23753992924,3cyclictest1125-21fschecks_time11:55:231
23753992924,3cyclictest1125-21fschecks_time11:55:231
23753992923,5cyclictest30754-21missed_timers10:20:251
23753992923,5cyclictest30754-21missed_timers10:20:251
23753992923,5cyclictest2525-21timerandwakeup10:30:331
23753992923,5cyclictest2525-21timerandwakeup10:30:331
23753992923,4cyclictest142-21systemd-journal12:22:171
23753992923,4cyclictest142-21systemd-journal12:22:171
23753992923,4cyclictest142-21systemd-journal12:22:171
23753992921,5cyclictest32052-21needreboot11:50:271
23752992924,3cyclictest31658-21gltestperf11:50:230
23752992924,3cyclictest0-21swapper/009:55:090
23752992924,3cyclictest0-21swapper/009:55:090
23752992922,6cyclictest11906-21kernelversion09:30:250
23752992922,6cyclictest11906-21kernelversion09:30:250
303922280,2sleep1271rcuc/111:45:291
303922280,2sleep1271rcuc/111:45:291
23755992824,3cyclictest431rcuc/311:31:093
23755992824,3cyclictest431rcuc/311:31:093
23755992821,5cyclictest431rcuc/310:18:083
23755992821,5cyclictest431rcuc/310:18:083
23753992824,3cyclictest7074-21ntp_offset07:50:271
23753992824,3cyclictest7074-21ntp_offset07:50:271
23753992823,3cyclictest27962-21gltestperf11:40:231
23753992822,4cyclictest17701-21fschecks_count08:20:221
23753992822,4cyclictest17701-21fschecks_count08:20:221
23753992821,5cyclictest7036-21unixbench_singl09:15:331
23753992821,5cyclictest7036-21unixbench_singl09:15:331
23753992821,5cyclictest7036-21unixbench_singl09:15:331
23753992821,5cyclictest19078-21proc_pri11:15:311
23753992821,5cyclictest19078-21proc_pri11:15:311
23753992821,5cyclictest19078-21proc_pri11:15:311
23753992821,5cyclictest142-21systemd-journal11:25:161
23753992821,5cyclictest142-21systemd-journal11:25:161
23752992822,5cyclictest30319-21processes11:45:290
23752992822,5cyclictest30319-21processes11:45:290
23752992822,4cyclictest14910-21cron09:40:090
23752992822,4cyclictest14910-21cron09:40:090
23752992821,5cyclictest3544-21sshd09:08:170
23752992821,5cyclictest3544-21sshd09:08:170
23752992815,7cyclictest749-21runrttasks11:20:090
23752992815,7cyclictest749-21runrttasks11:20:090
23752992815,7cyclictest749-21runrttasks11:20:090
23755992722,4cyclictest431rcuc/311:12:113
23755992722,4cyclictest431rcuc/311:12:113
23753992721,3cyclictest0-21swapper/112:25:241
23753992720,5cyclictest9996-21sendmail12:20:091
23753992720,5cyclictest9996-21sendmail12:20:091
23753992720,5cyclictest9996-21sendmail12:20:091
23752992723,2cyclictest0-21swapper/012:10:310
23752992722,4cyclictest8692-21kernelversion07:55:240
23752992722,4cyclictest8692-21kernelversion07:55:240
23752992722,4cyclictest8692-21kernelversion07:55:240
23752992722,4cyclictest29298-21latency_hist11:45:080
23752992721,5cyclictest23125-21kernelversion10:00:250
23752992721,4cyclictest21894-21unixbench-2d09:55:340
23752992721,4cyclictest21894-21unixbench-2d09:55:340
23752992721,4cyclictest21894-21unixbench-2d09:55:340
23752992721,4cyclictest0-21swapper/008:05:220
23752992721,4cyclictest0-21swapper/008:05:220
23752992720,5cyclictest29994-21latency_hist10:20:150
23752992720,5cyclictest29994-21latency_hist10:20:150
23752992720,4cyclictest0-21swapper/009:20:240
23752992720,4cyclictest0-21swapper/009:20:240
23755992621,4cyclictest431rcuc/310:49:123
23755992621,4cyclictest431rcuc/310:49:123
23755992621,3cyclictest431rcuc/310:52:503
23755992621,3cyclictest431rcuc/310:52:503
23755992621,3cyclictest431rcuc/307:54:123
23755992621,3cyclictest431rcuc/307:54:123
23753992621,4cyclictest749-21runrttasks11:35:291
23753992621,4cyclictest749-21runrttasks11:35:291
23753992620,5cyclictest9443-21kernelversion10:50:261
23753992620,5cyclictest9443-21kernelversion10:50:261
23753992618,6cyclictest27867-21sort08:45:321
23753992618,6cyclictest27867-21sort08:45:321
23753992618,6cyclictest1344-21cat07:35:251
23753992618,6cyclictest1344-21cat07:35:251
23753992618,6cyclictest1344-21cat07:35:251
23753992617,7cyclictest31644-21threads08:55:321
23753992617,7cyclictest31644-21threads08:55:321
23752992620,5cyclictest10338-21fschecks_time08:00:210
23752992620,5cyclictest10338-21fschecks_time08:00:210
23752992620,4cyclictest0-21swapper/011:30:260
23752992620,4cyclictest0-21swapper/011:30:260
23752992619,5cyclictest7794-21latency_hist09:20:210
23752992618,6cyclictest12775-21sort11:00:210
23752992618,6cyclictest12775-21sort11:00:210
23755992521,3cyclictest431rcuc/311:55:453
23755992521,3cyclictest431rcuc/311:55:453
23755992521,3cyclictest431rcuc/309:03:593
23755992521,3cyclictest431rcuc/309:03:593
23755992520,4cyclictest431rcuc/310:25:403
23755992520,4cyclictest431rcuc/310:25:403
23755992520,3cyclictest431rcuc/309:33:223
23755992520,3cyclictest431rcuc/309:33:223
23755992519,4cyclictest431rcuc/307:58:303
23755992519,4cyclictest431rcuc/307:58:303
23755992519,4cyclictest431rcuc/307:58:303
23755992518,5cyclictest431rcuc/310:04:093
23755992518,5cyclictest431rcuc/309:16:213
23755992518,5cyclictest431rcuc/309:16:213
23755992518,5cyclictest431rcuc/309:16:213
23753992520,4cyclictest142-21systemd-journal12:40:171
23753992520,4cyclictest142-21systemd-journal12:40:171
23753992519,4cyclictest0-21swapper/110:35:241
23753992519,4cyclictest0-21swapper/110:35:241
23753992519,3cyclictest0-21swapper/108:20:091
23753992519,3cyclictest0-21swapper/108:20:091
23753992519,3cyclictest0-21swapper/108:20:091
23753992517,6cyclictest31008-21latency_hist07:30:091
23753992517,6cyclictest31008-21latency_hist07:30:091
23752992520,4cyclictest1991-21kernelversion10:30:260
23752992520,4cyclictest1991-21kernelversion10:30:260
23752992520,3cyclictest23751-21cyclictest09:18:350
23752992520,3cyclictest23751-21cyclictest09:18:350
23752992518,5cyclictest31792-21unixbench-2d08:55:330
23752992518,5cyclictest31792-21unixbench-2d08:55:330
23752992517,6cyclictest20980-21processes11:20:290
23752992517,6cyclictest20980-21processes11:20:290
305352240,3sleep30-21swapper/307:25:323
305352240,3sleep30-21swapper/307:25:323
23755992420,3cyclictest431rcuc/311:41:383
23755992420,3cyclictest431rcuc/311:28:363
23755992420,3cyclictest431rcuc/311:28:363
23755992420,3cyclictest431rcuc/309:51:153
23755992420,3cyclictest431rcuc/309:51:153
23755992420,3cyclictest431rcuc/309:29:123
23755992420,3cyclictest431rcuc/309:29:123
23755992420,3cyclictest431rcuc/307:36:313
23755992420,3cyclictest431rcuc/307:36:313
23755992420,3cyclictest431rcuc/307:36:313
23755992419,4cyclictest431rcuc/311:23:093
23755992419,4cyclictest431rcuc/311:23:093
23755992419,3cyclictest431rcuc/312:26:213
23755992419,3cyclictest431rcuc/308:48:273
23755992419,3cyclictest431rcuc/308:48:273
23755992418,4cyclictest431rcuc/310:44:333
23755992418,4cyclictest431rcuc/310:44:333
23755992418,4cyclictest431rcuc/307:22:483
23755992418,4cyclictest431rcuc/307:22:483
2375499242,16cyclictest10843-21chrt08:00:292
2375499242,16cyclictest10843-21chrt08:00:292
23753992419,3cyclictest10428-21head08:00:221
23753992419,3cyclictest10428-21head08:00:221
23753992419,3cyclictest0-21swapper/109:10:211
23753992419,3cyclictest0-21swapper/108:40:091
23753992419,3cyclictest0-21swapper/108:40:091
23753992419,3cyclictest0-21swapper/108:40:091
23753992418,5cyclictest3007-21fschecks_time12:00:231
23753992418,5cyclictest3007-21fschecks_time12:00:231
23753992418,5cyclictest17538-21kernelversion09:45:251
23753992418,5cyclictest17538-21kernelversion09:45:251
23753992418,4cyclictest0-21swapper/109:55:091
23753992418,4cyclictest0-21swapper/109:55:091
23753992418,3cyclictest0-21swapper/109:30:311
23753992418,3cyclictest0-21swapper/109:30:311
23752992419,3cyclictest0-21swapper/009:00:230
23752992419,3cyclictest0-21swapper/009:00:230
23752992419,3cyclictest0-21swapper/008:30:220
23752992419,3cyclictest0-21swapper/007:20:290
23752992419,3cyclictest0-21swapper/007:20:290
23752992418,3cyclictest0-21swapper/011:38:170
23752992418,3cyclictest0-21swapper/011:38:170
23752992417,5cyclictest7255-21fschecks_count10:45:210
23752992417,5cyclictest7255-21fschecks_count10:45:210
23752992417,5cyclictest32247-21fschecks_time10:25:220
23752992417,5cyclictest32247-21fschecks_time10:25:220
23752992417,4cyclictest0-21swapper/008:40:220
23752992417,4cyclictest0-21swapper/008:40:220
23752992413,4cyclictest181rcu_preempt11:03:530
23752992413,4cyclictest181rcu_preempt11:03:530
23752992412,6cyclictest90-1pr/ttyS012:18:270
23752992412,6cyclictest90-1pr/ttyS012:18:270
23752992412,6cyclictest90-1pr/ttyS012:18:270
318802230,3sleep20-21swapper/210:25:142
318802230,3sleep20-21swapper/210:25:142
23755992319,3cyclictest431rcuc/311:37:003
23755992319,3cyclictest431rcuc/311:37:003
23755992319,3cyclictest431rcuc/310:05:423
23755992319,3cyclictest431rcuc/310:05:423
23755992319,3cyclictest431rcuc/309:39:573
23755992319,3cyclictest431rcuc/309:39:573
23755992319,3cyclictest431rcuc/308:53:093
23755992319,3cyclictest431rcuc/308:53:093
23755992319,3cyclictest431rcuc/308:27:043
23755992319,3cyclictest431rcuc/308:08:073
23755992319,3cyclictest431rcuc/308:08:073
23755992319,3cyclictest431rcuc/307:31:203
23755992319,3cyclictest431rcuc/307:31:203
23755992318,4cyclictest431rcuc/312:14:513
23755992318,3cyclictest431rcuc/311:48:183
23755992318,3cyclictest431rcuc/311:48:183
23755992318,3cyclictest431rcuc/308:15:143
23755992318,3cyclictest431rcuc/308:15:143
23753992319,3cyclictest16801-21latency_hist09:45:081
23753992318,2cyclictest0-21swapper/110:40:221
23753992318,2cyclictest0-21swapper/110:40:221
23753992316,4cyclictest0-21swapper/111:05:311
23753992316,4cyclictest0-21swapper/111:05:311
23752992318,3cyclictest0-21swapper/010:50:260
23752992318,3cyclictest0-21swapper/010:50:260
184962230,3sleep20-21swapper/211:15:232
184962230,3sleep20-21swapper/211:15:232
184962230,3sleep20-21swapper/211:15:232
23755992218,3cyclictest431rcuc/310:34:043
23755992218,3cyclictest431rcuc/310:34:043
23755992218,3cyclictest431rcuc/309:44:073
23755992217,3cyclictest431rcuc/310:14:223
23755992216,3cyclictest431rcuc/308:18:323
23755992216,3cyclictest431rcuc/308:18:323
23755992216,3cyclictest431rcuc/308:18:323
23753992217,3cyclictest0-21swapper/108:10:211
23753992217,3cyclictest0-21swapper/108:10:211
23753992216,4cyclictest0-21swapper/110:05:231
23753992216,4cyclictest0-21swapper/110:05:231
23753992216,4cyclictest0-21swapper/109:00:241
23753992216,4cyclictest0-21swapper/109:00:241
23753992216,3cyclictest0-21swapper/111:25:321
23753992216,3cyclictest0-21swapper/111:25:321
23753992214,6cyclictest23751-21cyclictest09:35:301
23753992214,6cyclictest23751-21cyclictest09:35:301
23753992211,8cyclictest142-21systemd-journal08:44:521
23753992211,8cyclictest142-21systemd-journal08:44:521
23753992210,3cyclictest181rcu_preempt07:45:251
23753992210,3cyclictest181rcu_preempt07:45:251
2375299229,3cyclictest181rcu_preempt10:08:410
2375299229,3cyclictest181rcu_preempt10:08:410
2375299221,8cyclictest29571-21grep07:25:230
2375299221,8cyclictest29571-21grep07:25:230
23752992217,3cyclictest0-21swapper/008:45:260
23752992217,3cyclictest0-21swapper/008:45:260
23752992216,3cyclictest0-21swapper/009:40:220
23752992215,5cyclictest23751-21cyclictest07:41:470
23752992215,5cyclictest23751-21cyclictest07:41:470
23752992215,5cyclictest1-21systemd07:36:170
23752992215,5cyclictest1-21systemd07:36:170
23752992215,5cyclictest1-21systemd07:36:170
23752992215,4cyclictest0-21swapper/008:50:250
23752992215,4cyclictest0-21swapper/008:50:250
23755992117,3cyclictest431rcuc/311:51:193
23755992117,3cyclictest431rcuc/310:58:083
23755992117,3cyclictest431rcuc/310:58:083
23755992117,3cyclictest431rcuc/308:01:233
23755992117,3cyclictest431rcuc/308:01:233
23753992116,3cyclictest0-21swapper/108:30:301
23753992113,6cyclictest21003-21fschecks_time09:55:241
23753992113,6cyclictest21003-21fschecks_time09:55:241
23753992113,6cyclictest21003-21fschecks_time09:55:241
23752992115,4cyclictest3485-21fschecks_count10:35:200
23752992115,4cyclictest3485-21fschecks_count10:35:200
23752992115,4cyclictest0-21swapper/012:00:240
23752992115,4cyclictest0-21swapper/012:00:240
23755992016,3cyclictest431rcuc/310:23:033
23755992016,3cyclictest431rcuc/310:23:033
23755992016,3cyclictest431rcuc/307:40:413
23755992016,3cyclictest431rcuc/307:40:413
23755992015,3cyclictest431rcuc/312:03:533
23755992015,3cyclictest431rcuc/312:03:533
23753992015,3cyclictest0-21swapper/111:00:231
23753992015,3cyclictest0-21swapper/111:00:231
23753992015,3cyclictest0-21swapper/110:45:291
23753992015,3cyclictest0-21swapper/110:45:291
23753992014,4cyclictest0-21swapper/109:05:251
23753992014,4cyclictest0-21swapper/109:05:251
23753992013,4cyclictest0-21swapper/110:15:121
23755991915,3cyclictest431rcuc/312:06:393
23755991915,3cyclictest431rcuc/312:06:393
23754991914,3cyclictest101002sleep209:25:242
23754991914,3cyclictest101002sleep209:25:242
208892190,2sleep30-21swapper/309:55:243
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional