You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-24 - 20:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Thu Sep 24, 2026 12:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
70462760,3sleep30-21swapper/311:24:413
70462760,3sleep30-21swapper/311:24:413
270592690,3sleep30-21swapper/307:59:383
270592690,3sleep30-21swapper/307:59:383
194102680,3sleep3431rcuc/307:39:323
194102680,3sleep3431rcuc/307:39:323
113702630,2sleep30-21swapper/308:44:323
113702630,2sleep30-21swapper/308:44:323
279612570,4sleep127964-21grep07:59:481
279612570,4sleep127964-21grep07:59:481
270262570,3sleep20-21swapper/207:59:372
270262570,3sleep20-21swapper/207:59:372
11992560,3sleep20-21swapper/212:34:502
219212540,3chrt0-21swapper/310:39:303
219212540,3chrt0-21swapper/310:39:303
221172530,2chrt22121-21missed_timers12:04:421
59192490,4chrt0-21swapper/309:54:433
41582490,3sleep00-21swapper/008:24:390
41582490,3sleep00-21swapper/008:24:390
305272490,2sleep030461-21latency_hist08:09:280
305272490,2sleep030461-21latency_hist08:09:280
141102490,3sleep20-21swapper/208:49:462
253992480,3sleep20-21swapper/207:54:382
253992480,3sleep20-21swapper/207:54:382
225752470,3sleep30-21swapper/312:04:483
41152430,2chrt4116-21/usr/sbin/munin09:49:460
81512420,4sleep20-21swapper/208:34:422
81512420,4sleep20-21swapper/208:34:422
10364994235,5cyclictest12475-21cron10:14:261
296542410,2sleep30-21swapper/310:59:413
296542410,2sleep30-21swapper/310:59:413
160592410,2sleep30-21swapper/311:49:373
160592410,2sleep30-21swapper/311:49:373
158282410,3sleep015823-21grep08:54:420
205732390,2sleep020576-21sort11:59:470
205732390,2sleep020576-21sort11:59:470
10358993931,6cyclictest816-21netstat08:14:440
10358993930,7cyclictest3426-21netstat11:14:460
320952380,3sleep30-21swapper/311:04:463
320952380,3sleep30-21swapper/311:04:463
175752380,2sleep00-21swapper/011:54:290
175752380,2sleep00-21swapper/011:54:290
10364993829,7cyclictest17630-21unixbench-2d10:24:481
10364993829,7cyclictest17630-21unixbench-2d10:24:481
270472370,1sleep1271rcuc/109:24:421
270472370,1sleep1271rcuc/109:24:421
182852370,3sleep20-21swapper/211:54:422
10364993629,5cyclictest22995-21latency_hist07:49:261
10364993528,5cyclictest18104-21cut11:54:401
10364993526,7cyclictest31492-21processes08:09:451
10364993430,3cyclictest21123-21gltestperf09:09:411
10364993430,3cyclictest21123-21gltestperf09:09:411
10358993428,4cyclictest10345-21cyclictest12:34:500
12712330,3sleep20-21swapper/208:14:492
10364993326,5cyclictest30391-21fschecks_time09:34:391
10364993326,5cyclictest30391-21fschecks_time09:34:391
10358993325,6cyclictest9115-21fschecks_count10:04:390
10364993225,5cyclictest32614-21wc09:39:421
10364993225,5cyclictest32614-21wc09:39:421
10364993225,5cyclictest32614-21wc09:39:421
10364993225,5cyclictest13371-21unixbench_singl11:39:491
10364993225,5cyclictest13371-21unixbench_singl11:39:491
10364993225,5cyclictest10345-21cyclictest12:34:511
10358993226,4cyclictest31243-21gltestperf12:29:380
1036499317,7cyclictest29-21ksoftirqd/109:54:381
10364993127,3cyclictest28178-21kernelversion10:54:471
10364993127,3cyclictest28178-21kernelversion10:54:471
10364993125,3cyclictest0-21swapper/109:34:261
10364993125,3cyclictest0-21swapper/109:34:261
10364993122,2cyclictest181rcu_preempt11:59:381
10364993122,2cyclictest181rcu_preempt11:59:381
10364993112,7cyclictest29-21ksoftirqd/108:24:271
10364993112,7cyclictest29-21ksoftirqd/108:24:271
10364993112,7cyclictest29-21ksoftirqd/108:24:271
10358993125,4cyclictest22405-21cron09:14:260
10358993125,4cyclictest22405-21cron09:14:260
10358993124,5cyclictest21993-21kernelversion12:04:410
10358993122,7cyclictest4836-21fschecks_time11:19:360
10358993122,7cyclictest4836-21fschecks_time11:19:360
10364993024,5cyclictest9090-21netstat11:29:431
10364993024,5cyclictest9090-21netstat11:29:431
10364993024,4cyclictest15820-21tail08:54:421
10364993023,5cyclictest20474-21fschecks_time10:34:431
10364993023,5cyclictest20474-21fschecks_time10:34:431
10364993022,6cyclictest18283-21needreboot07:34:431
10364993022,6cyclictest18283-21needreboot07:34:431
10364993015,4cyclictest90-1pr/ttyS008:31:281
10364993011,5cyclictest29-21ksoftirqd/108:44:381
10364993011,5cyclictest29-21ksoftirqd/108:44:381
10364993010,8cyclictest29-21ksoftirqd/110:19:391
10364993010,8cyclictest29-21ksoftirqd/110:19:391
10358993023,5cyclictest0-21swapper/012:19:460
10358993023,5cyclictest0-21swapper/012:19:460
10358993023,5cyclictest0-21swapper/012:19:460
10358993020,8cyclictest27429-21kernelversion07:59:410
10358993020,8cyclictest27429-21kernelversion07:59:410
1036499296,7cyclictest29-21ksoftirqd/108:24:461
1036499296,7cyclictest29-21ksoftirqd/108:24:461
10364992923,5cyclictest18834-21kernelversion10:29:401
10364992921,6cyclictest717-21latency_hist11:09:311
10364992921,6cyclictest717-21latency_hist11:09:311
10364992921,6cyclictest25613-21awk10:49:261
10364992921,6cyclictest25613-21awk10:49:261
10364992920,7cyclictest30037-21threads12:24:471
10364992920,7cyclictest30037-21threads12:24:471
10364992917,9cyclictest10753-21latency_hist10:09:311
10364992916,3cyclictest90-1pr/ttyS007:51:411
10364992911,6cyclictest29-21ksoftirqd/110:54:321
10364992911,3cyclictest281ktimers/109:07:081
10358992924,4cyclictest10345-21cyclictest09:29:400
10358992924,4cyclictest10345-21cyclictest09:29:400
10358992921,6cyclictest12362-21fschecks_time11:39:390
10358992921,6cyclictest12362-21fschecks_time11:39:390
10358992920,7cyclictest26182-21latency_hist09:24:260
10358992920,7cyclictest26182-21latency_hist09:24:260
1036499283,14cyclictest23929-21seq09:14:521
1036499283,14cyclictest23929-21seq09:14:521
10364992823,3cyclictest0-21swapper/108:49:391
10364992821,5cyclictest25006-21kernelversion09:19:411
10364992821,5cyclictest25006-21kernelversion09:19:411
10364992817,3cyclictest181rcu_preempt12:13:141
10358992824,3cyclictest19084-21ntp_offset10:29:440
10358992823,3cyclictest0-21swapper/012:14:450
10358992823,3cyclictest0-21swapper/010:44:380
10358992823,3cyclictest0-21swapper/010:44:380
10358992823,3cyclictest0-21swapper/010:24:270
10358992823,3cyclictest0-21swapper/010:24:270
10358992822,5cyclictest3843-21latency_hist12:44:260
10358992822,5cyclictest3843-21latency_hist12:44:260
10358992822,5cyclictest3843-21latency_hist12:44:260
284192270,1sleep00-21swapper/010:54:500
284192270,1sleep00-21swapper/010:54:500
214672270,3chrt0-21swapper/307:44:383
214242270,3sleep20-21swapper/209:09:442
214242270,3sleep20-21swapper/209:09:442
128752270,2sleep112874-21fschecks_count10:14:431
1036499279,8cyclictest29-21ksoftirqd/109:49:391
1036499276,3cyclictest281ktimers/109:44:401
10364992722,3cyclictest11173-21basename08:44:261
10364992722,3cyclictest11173-21basename08:44:261
10364992718,7cyclictest8120-21kernelversion08:34:421
10364992718,7cyclictest8120-21kernelversion08:34:421
10358992720,5cyclictest1683-21cut09:44:380
10358992720,5cyclictest14302-21sshd10:18:400
10358992720,5cyclictest11022-21sshd08:42:390
10358992720,5cyclictest11022-21sshd08:42:390
10358992719,6cyclictest19464-21sshd07:39:350
10358992719,6cyclictest19464-21sshd07:39:350
203692260,3sleep20-21swapper/211:59:452
203692260,3sleep20-21swapper/211:59:452
1036499267,7cyclictest29-21ksoftirqd/108:59:391
1036499267,7cyclictest29-21ksoftirqd/108:59:391
1036499265,4cyclictest281ktimers/110:59:391
1036499265,4cyclictest281ktimers/110:59:391
10364992621,3cyclictest0-21swapper/107:39:381
10364992621,3cyclictest0-21swapper/107:39:381
10364992618,6cyclictest16851-21sort11:49:461
10364992618,6cyclictest16851-21sort11:49:461
10364992612,4cyclictest29-21ksoftirqd/111:09:481
10364992612,4cyclictest29-21ksoftirqd/111:09:481
1036499261,18cyclictest3473-21taskset11:14:471
1036499260,7cyclictest302172sleep108:06:191
1036499260,7cyclictest302172sleep108:06:191
10358992620,5cyclictest10345-21cyclictest10:39:460
10358992620,5cyclictest10345-21cyclictest10:39:460
10358992619,5cyclictest32270-21gltestperf09:39:390
10358992619,5cyclictest32270-21gltestperf09:39:390
10358992619,5cyclictest32270-21gltestperf09:39:390
10358992618,6cyclictest26622-21processes10:49:450
10358992618,6cyclictest18618-21threads07:34:470
10358992618,6cyclictest18618-21threads07:34:470
1036499258,7cyclictest29-21ksoftirqd/112:14:521
1036499257,7cyclictest29-21ksoftirqd/111:24:481
1036499257,7cyclictest29-21ksoftirqd/111:24:481
1036499257,7cyclictest29-21ksoftirqd/109:59:471
1036499257,7cyclictest29-21ksoftirqd/109:59:471
1036499256,5cyclictest29-21ksoftirqd/110:39:401
1036499256,5cyclictest29-21ksoftirqd/110:39:401
1036499255,8cyclictest29-21ksoftirqd/111:34:481
10364992519,3cyclictest0-21swapper/108:14:391
1036499251,8cyclictest258312/usr/sbin/munin07:54:441
1036499251,8cyclictest258312/usr/sbin/munin07:54:441
10364992518,6cyclictest545-21in:imuxsock11:20:391
10364992518,6cyclictest545-21in:imuxsock11:20:391
10364992518,4cyclictest0-21swapper/112:39:491
10364992518,4cyclictest0-21swapper/112:39:491
10364992518,4cyclictest0-21swapper/112:39:491
10364992518,4cyclictest0-21swapper/112:19:411
10364992518,4cyclictest0-21swapper/112:19:411
10364992518,4cyclictest0-21swapper/112:19:411
10358992520,3cyclictest0-21swapper/009:04:490
10358992519,5cyclictest9152-21sshd08:37:390
10358992519,5cyclictest9152-21sshd08:37:390
10358992519,3cyclictest0-21swapper/008:59:470
10358992519,3cyclictest0-21swapper/008:59:470
10358992518,5cyclictest14594-21sshd08:50:030
10358992517,6cyclictest1667-21processes11:09:480
10358992517,6cyclictest1667-21processes11:09:480
10358992517,6cyclictest11938-21sort08:44:390
10358992517,6cyclictest11938-21sort08:44:390
259492240,3chrt0-21swapper/212:14:482
1036499248,8cyclictest29-21ksoftirqd/111:44:501
10364992414,7cyclictest31385-21kernelversion12:29:401
10358992420,3cyclictest16930-21if_eth010:24:400
10358992420,3cyclictest16930-21if_eth010:24:400
10358992420,2cyclictest0-21swapper/009:14:380
10358992420,2cyclictest0-21swapper/009:14:380
10358992420,2cyclictest0-21swapper/008:24:270
10358992420,2cyclictest0-21swapper/008:24:270
10358992420,2cyclictest0-21swapper/008:24:270
10358992419,3cyclictest0-21swapper/012:09:440
10358992418,5cyclictest23466-21fschecks_time07:49:380
10358992418,4cyclictest10345-21cyclictest12:24:470
10358992418,4cyclictest10345-21cyclictest12:24:470
10358992418,3cyclictest0-21swapper/009:59:410
10358992418,3cyclictest0-21swapper/009:59:410
10358992417,4cyclictest0-21swapper/010:59:430
10358992417,4cyclictest0-21swapper/010:59:430
10358992415,7cyclictest14235-21fschecks_time11:44:380
10358992318,3cyclictest0-21swapper/007:54:460
10358992318,3cyclictest0-21swapper/007:54:460
10358992318,3cyclictest0-21swapper/007:44:480
10358992314,7cyclictest32092-21head11:04:470
10358992314,7cyclictest32092-21head11:04:470
76812220,2sleep20-21swapper/211:24:472
76812220,2sleep20-21swapper/211:24:472
10380992217,3cyclictest45292sleep308:24:423
10380992217,3cyclictest45292sleep308:24:423
10372992218,3cyclictest351rcuc/211:05:272
10372992218,3cyclictest351rcuc/211:05:272
10358992218,3cyclictest9121-21ntp_offset11:29:440
10358992218,3cyclictest9121-21ntp_offset11:29:440
10358992218,2cyclictest0-21swapper/008:09:430
10358992217,3cyclictest0-21swapper/009:34:390
10358992217,3cyclictest0-21swapper/009:34:390
10358992213,6cyclictest8285-21sort11:29:320
10358992213,6cyclictest8285-21sort11:29:320
70712211,2sleep20-21swapper/209:59:382
70712211,2sleep20-21swapper/209:59:382
142352210,3sleep30-21swapper/308:49:473
10358992116,3cyclictest0-21swapper/011:34:490
10358992116,3cyclictest0-21swapper/008:29:490
10358992114,5cyclictest5916-21ntpq09:54:430
10358992113,6cyclictest11357-21cut10:09:410
10372992012,5cyclictest126192chrt10:14:322
10358992015,3cyclictest0-21swapper/011:54:400
10358992015,3cyclictest0-21swapper/009:24:400
10358992015,3cyclictest0-21swapper/009:24:400
10358992010,8cyclictest20804-21memory10:34:460
10358992010,8cyclictest20804-21memory10:34:460
57372190,3sleep20-21swapper/208:29:322
57372190,3sleep20-21swapper/208:29:322
10372991914,4cyclictest351rcuc/209:20:382
10372991914,4cyclictest351rcuc/209:20:382
1037299191,13cyclictest25691-21chrt10:49:302
1037299191,13cyclictest25691-21chrt10:49:302
10380991814,3cyclictest431rcuc/311:41:583
10380991814,3cyclictest431rcuc/311:41:583
1038099181,14cyclictest9066-21chrt11:29:433
1038099181,14cyclictest9066-21chrt11:29:433
1038099181,13cyclictest2178-21chrt12:39:343
1038099181,11cyclictest0-21swapper/307:49:363
1037299181,12cyclictest1385-21taskset09:44:332
1037299181,12cyclictest1385-21taskset09:44:332
1037299181,12cyclictest1385-21taskset09:44:332
102672180,3sleep20-21swapper/208:39:452
102672180,3sleep20-21swapper/208:39:452
1038099171,13cyclictest28064-21taskset10:54:453
1038099171,13cyclictest28064-21taskset10:54:453
1038099171,11cyclictest7809-21chrt09:59:463
1038099171,11cyclictest7809-21chrt09:59:463
1037299179,6cyclictest13070-21chrt08:49:262
1037299179,6cyclictest13070-21chrt08:49:262
10372991712,3cyclictest351rcuc/209:09:082
10372991712,3cyclictest351rcuc/207:39:192
10372991712,3cyclictest351rcuc/207:39:192
10372991711,4cyclictest351rcuc/211:13:062
10372991711,4cyclictest351rcuc/211:13:062
1037299171,13cyclictest2320-21chrt08:19:392
1037299171,13cyclictest2320-21chrt08:19:392
1037299171,13cyclictest2320-21chrt08:19:392
1038099162,10cyclictest22202sleep311:10:543
1038099162,10cyclictest22202sleep311:10:543
10380991611,3cyclictest431rcuc/309:29:523
10380991611,3cyclictest431rcuc/309:29:523
1038099161,13cyclictest29413-21chrt12:24:383
1038099161,13cyclictest29413-21chrt12:24:383
1038099161,13cyclictest18629-21taskset11:54:473
1038099161,12cyclictest27414-21chrt09:24:483
1038099161,12cyclictest27414-21chrt09:24:483
1038099161,12cyclictest26229-21chrt10:49:393
1038099161,12cyclictest18904-21chrt10:29:413
1038099161,11cyclictest0-21swapper/312:04:373
1037299168,4cyclictest217522sleep212:04:392
1037299162,9cyclictest100022sleep211:34:092
1037299162,9cyclictest100022sleep211:34:092
10372991612,3cyclictest351rcuc/211:53:352
10372991612,3cyclictest351rcuc/211:53:352
10372991611,3cyclictest351rcuc/210:06:092
10372991611,3cyclictest351rcuc/209:15:552
10372991611,3cyclictest351rcuc/209:15:552
1037299161,12cyclictest21077-21taskset10:34:502
1037299161,12cyclictest21077-21taskset10:34:502
1037299161,11cyclictest4887-21chrt11:19:372
1037299161,11cyclictest4887-21chrt11:19:372
1037299160,11cyclictest26070-21taskset10:49:382
47322151,2sleep30-21swapper/309:51:433
257942150,4sleep30-21swapper/307:54:433
257942150,4sleep30-21swapper/307:54:433
1038099151,8cyclictest0-21swapper/310:04:383
10380991511,3cyclictest431rcuc/311:18:503
10380991511,3cyclictest431rcuc/310:15:153
10380991511,3cyclictest431rcuc/309:19:463
10380991511,3cyclictest431rcuc/309:19:463
10380991511,3cyclictest431rcuc/308:18:283
1038099151,12cyclictest20467-21taskset07:39:483
1038099151,12cyclictest20467-21taskset07:39:483
1038099151,11cyclictest2726-21taskset09:44:503
1038099151,11cyclictest23800-21taskset10:44:283
1038099151,11cyclictest23800-21taskset10:44:283
1038099151,11cyclictest0-21swapper/312:19:353
1038099151,11cyclictest0-21swapper/312:19:353
1038099151,11cyclictest0-21swapper/312:19:353
1038099151,11cyclictest0-21swapper/308:44:363
1038099151,11cyclictest0-21swapper/308:44:363
1038099151,10cyclictest22647-21chrt09:14:353
1038099151,10cyclictest22647-21chrt09:14:353
1038099151,10cyclictest11117-21chrt10:09:393
1037299159,4cyclictest351rcuc/208:09:302
1037299159,4cyclictest351rcuc/208:09:302
10372991511,3cyclictest351rcuc/208:12:402
1037299151,11cyclictest18805-21taskset10:29:402
1037299151,11cyclictest13079-21chrt10:14:442
1037299151,10cyclictest28149-21chrt09:29:302
1037299151,10cyclictest28149-21chrt09:29:302
10372991510,3cyclictest351rcuc/210:42:072
10372991510,3cyclictest351rcuc/210:42:072
10372991510,3cyclictest351rcuc/209:54:552
10372991510,3cyclictest183242chrt09:00:072
10372991510,3cyclictest183242chrt09:00:072
115662141,2sleep20-21swapper/211:35:132
1038099149,4cyclictest431rcuc/310:21:103
1038099149,4cyclictest431rcuc/310:21:103
1038099149,3cyclictest302822chrt08:07:103
1038099149,3cyclictest302822chrt08:07:103
1038099149,3cyclictest266102chrt12:15:343
1038099141,9cyclictest30998-21chrt12:29:373
1038099141,9cyclictest1397-21chrt09:44:343
1038099141,9cyclictest1397-21chrt09:44:343
1038099141,9cyclictest1397-21chrt09:44:343
1038099141,11cyclictest20473-21chrt11:59:463
1038099141,11cyclictest20047-21taskset09:04:503
1038099141,10cyclictest2457-21chrt08:19:403
1038099141,10cyclictest2457-21chrt08:19:403
1038099141,10cyclictest2457-21chrt08:19:403
10380991410,3cyclictest431rcuc/310:26:563
10380991410,3cyclictest431rcuc/310:26:563
1037299149,3cyclictest298502chrt09:33:522
1037299149,3cyclictest298502chrt09:33:522
1037299149,3cyclictest296032chrt10:59:392
1037299149,3cyclictest296032chrt10:59:392
1037299141,9cyclictest0-21swapper/207:49:362
1037299141,11cyclictest31379-21taskset12:29:402
1037299141,10cyclictest23533-21chrt12:09:382
1037299141,10cyclictest22108-21chrt07:44:452
1037299141,10cyclictest1552-21chrt09:44:372
10372991410,3cyclictest351rcuc/209:37:022
10372991410,3cyclictest351rcuc/209:37:022
1038099138,4cyclictest431rcuc/309:04:063
1038099138,4cyclictest431rcuc/309:04:063
1038099138,3cyclictest91902chrt08:38:093
1038099138,3cyclictest91902chrt08:38:093
1038099138,3cyclictest37092chrt12:42:593
1038099138,3cyclictest37092chrt12:42:593
1038099138,3cyclictest37092chrt12:42:593
1038099138,3cyclictest155692chrt11:48:123
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional