You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-20 - 00:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Sat Sep 19, 2026 12:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
739021140,2sleep07394-21needreboot10:04:410
739021140,2sleep07394-21needreboot10:04:410
79052830,3sleep00-21swapper/008:39:380
79052830,3sleep00-21swapper/008:39:380
193472770,1sleep00-21swapper/007:44:350
125442770,5sleep30-21swapper/311:44:423
125442770,5sleep30-21swapper/311:44:423
267272750,2chrt0-21swapper/009:29:390
176242690,2sleep017627-21cut09:04:430
176242690,2sleep017627-21cut09:04:430
279942650,2chrt27987-21gzip10:59:411
279942650,2chrt27987-21gzip10:59:411
10412620,2sleep00-21swapper/012:39:470
10412620,2sleep00-21swapper/012:39:470
171842590,3sleep30-21swapper/310:29:443
171842590,3sleep30-21swapper/310:29:443
242652570,10sleep0171ktimers/010:49:390
261742490,3chrt0-21swapper/309:29:343
141102490,3chrt0-21swapper/311:49:363
141102490,3chrt0-21swapper/311:49:363
220272470,3sleep08270-21cyclictest07:49:450
220272470,3sleep08270-21cyclictest07:49:450
3882460,5sleep20-21swapper/208:19:382
3882460,5sleep20-21swapper/208:19:382
232402460,2sleep20-21swapper/210:47:412
6032400,2sleep00-21swapper/011:14:360
6032400,2sleep00-21swapper/011:14:360
221702400,2sleep021154-21/usr/sbin/munin12:09:440
221702400,2sleep021154-21/usr/sbin/munin12:09:440
216432390,3sleep30-21swapper/310:44:273
216432390,3sleep30-21swapper/310:44:273
49502380,2sleep20-21swapper/209:59:362
49502380,2sleep20-21swapper/209:59:362
322852380,3sleep20-21swapper/212:39:282
322852380,3sleep20-21swapper/212:39:282
308092360,2sleep131000-21sed09:39:461
308092360,2sleep131000-21sed09:39:461
207122360,2sleep20-21swapper/210:39:442
207122360,2sleep20-21swapper/210:39:442
100292360,3sleep00-21swapper/008:44:450
68352350,4sleep30-21swapper/310:04:353
68352350,4sleep30-21swapper/310:04:353
231162350,3sleep20-21swapper/209:19:442
231162350,3sleep20-21swapper/209:19:442
73882340,3sleep07391-21unixbench_singl11:29:470
73882340,3sleep07391-21unixbench_singl11:29:470
308432340,2sleep030847-21gltestperf12:34:350
308432340,2sleep030847-21gltestperf12:34:350
165582340,2sleep016-21ksoftirqd/011:54:430
8271993326,5cyclictest550-21cron09:54:210
8271993326,5cyclictest550-21cron09:54:210
176812330,2sleep30-21swapper/311:59:373
176812330,2sleep30-21swapper/311:59:373
176812330,2sleep30-21swapper/311:59:373
130212330,2sleep30-21swapper/308:54:333
8272993226,4cyclictest12595-21proc_pri11:44:421
8272993226,4cyclictest12595-21proc_pri11:44:421
8272993225,5cyclictest14678-21systemd-journal10:19:211
8272993225,5cyclictest14678-21systemd-journal10:19:211
8271993227,4cyclictest572-21cups-browsed08:29:420
8271993227,4cyclictest572-21cups-browsed08:29:420
8271993225,5cyclictest24123-21timerwakeupswit12:14:450
8271993225,5cyclictest18419-21threads11:59:460
8271993225,5cyclictest18419-21threads11:59:460
8271993225,5cyclictest18419-21threads11:59:460
282412320,3sleep20-21swapper/208:09:222
8272993127,3cyclictest10344-21unixbench-2d08:44:471
8272993125,4cyclictest2714-21gltestperf11:19:361
8272993125,4cyclictest2714-21gltestperf11:19:361
8272993125,4cyclictest2714-21gltestperf11:19:361
8272993123,6cyclictest5334-21kernelversion09:59:391
8272993123,6cyclictest5334-21kernelversion09:59:391
8271993126,4cyclictest572-21cups-browsed12:19:430
8271993126,4cyclictest572-21cups-browsed12:19:430
8271993124,5cyclictest6099-21latency_hist11:29:280
8271993124,5cyclictest6099-21latency_hist11:29:280
85112300,3sleep30-21swapper/308:39:453
85112300,3sleep30-21swapper/308:39:453
8272993025,3cyclictest0-21swapper/112:14:341
8272993024,4cyclictest8374-21gltestperf11:34:381
8272993024,4cyclictest31998-21gltestperf09:44:351
8272993024,4cyclictest31998-21gltestperf09:44:351
8272993024,4cyclictest29542-21cron09:39:221
8272993024,4cyclictest22056-21gltestperf10:44:381
8272993023,5cyclictest13266-21gltestperf08:54:351
8271993025,3cyclictest4013-21cron11:24:220
8271993025,3cyclictest4013-21cron11:24:220
8271993025,3cyclictest4013-21cron11:24:220
8271993024,4cyclictest572-21cups-browsed10:24:420
8271993024,4cyclictest572-21cups-browsed08:54:420
8271993023,5cyclictest28192-21sshd12:26:390
8271993023,5cyclictest28192-21sshd12:26:390
8272992923,4cyclictest27047-21fschecks_time12:24:351
8272992923,4cyclictest27047-21fschecks_time12:24:351
8272992923,4cyclictest17931-21unixbench_singl09:04:451
8272992923,4cyclictest17931-21unixbench_singl09:04:451
8272992923,4cyclictest15863-21gltestperf11:54:351
8272992922,5cyclictest550-21cron12:44:221
8272992922,5cyclictest550-21cron12:44:221
8272992922,5cyclictest32649-21sshd11:13:401
8272992922,5cyclictest32649-21sshd11:13:401
8272992921,6cyclictest18716-21ntp_kernel_pll_10:34:401
8272992921,6cyclictest18716-21ntp_kernel_pll_10:34:401
8271992925,2cyclictest0-21swapper/009:19:420
8271992925,2cyclictest0-21swapper/009:19:420
8271992924,3cyclictest12710-21gltestperf10:19:370
8271992924,3cyclictest12710-21gltestperf10:19:370
8271992924,3cyclictest12710-21gltestperf10:19:370
8271992924,3cyclictest10262-21cron10:14:220
8271992924,3cyclictest10262-21cron10:14:220
8271992923,4cyclictest12142-21latency_hist10:19:220
8271992923,4cyclictest12142-21latency_hist10:19:220
8272992823,4cyclictest18060-21needreboot11:59:411
8272992823,4cyclictest18060-21needreboot11:59:411
8272992823,4cyclictest18060-21needreboot11:59:411
8272992823,3cyclictest0-21swapper/111:29:421
8272992823,3cyclictest0-21swapper/111:29:421
8272992822,4cyclictest17801-21idleruntime-cro10:34:231
8272992822,4cyclictest17801-21idleruntime-cro10:34:231
8272992821,5cyclictest15966-21latency_hist10:29:241
8272992820,6cyclictest24511-21latency_hist07:59:211
8271992824,3cyclictest26371-21idleruntime-cro08:04:220
8271992824,3cyclictest26371-21idleruntime-cro08:04:220
8271992823,3cyclictest22101-21latency_hist09:19:220
8271992823,3cyclictest0-21swapper/011:39:220
8271992823,3cyclictest0-21swapper/010:59:420
8271992823,3cyclictest0-21swapper/010:59:420
8271992822,5cyclictest15684-21gltestperf07:34:340
8271992822,4cyclictest1346-21avahi-daemon10:34:410
8271992822,4cyclictest1346-21avahi-daemon10:34:410
211712280,2sleep121194-21open_files09:14:421
166412280,3sleep20-21swapper/209:04:292
166412280,3sleep20-21swapper/209:04:292
8278992721,4cyclictest351rcuc/209:41:202
8278992721,4cyclictest351rcuc/209:41:202
8278992721,4cyclictest351rcuc/207:56:322
8272992723,3cyclictest17888-21missed_timers07:39:371
8272992723,3cyclictest17888-21missed_timers07:39:371
8272992723,2cyclictest0-21swapper/110:09:441
8272992723,2cyclictest0-21swapper/110:09:441
8272992722,4cyclictest6899-21fschecks_count10:04:371
8272992722,4cyclictest6899-21fschecks_count10:04:371
8272992722,4cyclictest2295-21missed_timers08:24:401
8272992722,4cyclictest2295-21missed_timers08:24:401
8272992722,3cyclictest3908-21idleruntime08:29:351
8272992722,3cyclictest3908-21idleruntime08:29:351
8272992722,3cyclictest16159-21sshd09:00:401
8272992722,3cyclictest16159-21sshd09:00:401
8272992721,4cyclictest3285-21gltestperf09:54:341
8272992721,4cyclictest26214-21fschecks_count09:29:341
8272992721,4cyclictest25091-21gltestperf07:59:361
8272992721,4cyclictest25091-21gltestperf07:59:361
8272992721,4cyclictest0-21swapper/111:24:361
8272992721,4cyclictest0-21swapper/111:24:361
8272992720,5cyclictest28780-21gltestperf08:09:351
8272992720,5cyclictest1027-21latency11:14:391
8272992720,5cyclictest1027-21latency11:14:391
8271992723,3cyclictest8270-21cyclictest09:25:020
8271992723,3cyclictest8270-21cyclictest09:25:020
8271992722,4cyclictest572-21cups-browsed09:39:440
8271992722,4cyclictest572-21cups-browsed09:39:440
8271992722,3cyclictest881-21awk09:49:230
8271992722,3cyclictest881-21awk09:49:230
8271992722,3cyclictest8270-21cyclictest11:14:210
8271992722,3cyclictest8270-21cyclictest11:14:210
8271992722,3cyclictest20095-21fschecks_time10:39:360
8271992722,3cyclictest20095-21fschecks_time10:39:360
8271992720,5cyclictest29446-21cut11:04:350
8271992720,5cyclictest25667-21fschecks_time10:54:350
8271992720,5cyclictest21973-21cut10:44:380
8278992619,5cyclictest351rcuc/212:17:342
8272992622,3cyclictest31645-21unixbench-2d12:34:451
8272992622,3cyclictest31645-21unixbench-2d12:34:451
8272992621,4cyclictest19810-21head07:44:401
8272992621,3cyclictest749-21runrttasks10:51:221
8272992621,3cyclictest21479-21gltestperf12:09:351
8272992621,3cyclictest21479-21gltestperf12:09:351
8272992621,3cyclictest0-21swapper/109:49:391
8272992621,3cyclictest0-21swapper/109:49:391
8272992620,4cyclictest19570-21fschecks_time12:04:381
8272992620,4cyclictest19570-21fschecks_time12:04:381
8272992620,4cyclictest19357-21proc_pri09:09:421
8272992620,4cyclictest19357-21proc_pri09:09:421
8272992620,4cyclictest0-21swapper/112:24:211
8272992620,4cyclictest0-21swapper/112:24:211
8272992619,5cyclictest0-21swapper/108:14:351
8272992611,13cyclictest14678-21systemd-journal09:29:221
8272992611,13cyclictest14678-21systemd-journal09:29:221
258352260,3chrt0-21swapper/309:29:223
258352260,3chrt0-21swapper/309:29:223
242942260,3sleep00-21swapper/007:56:410
8278992520,4cyclictest351rcuc/211:45:542
8278992520,4cyclictest351rcuc/211:45:542
8278992520,4cyclictest351rcuc/208:09:462
8278992520,3cyclictest351rcuc/211:27:252
8278992520,3cyclictest351rcuc/211:27:252
8278992518,5cyclictest351rcuc/211:20:462
8278992518,5cyclictest351rcuc/211:20:462
8278992518,5cyclictest351rcuc/211:20:462
8278992518,5cyclictest351rcuc/208:47:172
8278992517,6cyclictest351rcuc/209:10:452
8278992517,6cyclictest351rcuc/209:10:452
8272992521,3cyclictest5771-21gltestperf08:34:351
8272992520,4cyclictest13983-21gltestperf11:49:351
8272992520,4cyclictest13983-21gltestperf11:49:351
8272992520,4cyclictest10043-21fschecks_count11:39:361
8272992520,4cyclictest10043-21fschecks_count11:39:361
8272992520,3cyclictest0-21swapper/108:39:431
8272992520,3cyclictest0-21swapper/108:39:431
8272992519,4cyclictest0-21swapper/112:29:451
8272992519,4cyclictest0-21swapper/112:29:451
8272992519,4cyclictest0-21swapper/109:19:471
8272992519,4cyclictest0-21swapper/109:19:471
8272992517,6cyclictest21322-21gltestperf07:49:361
8272992517,6cyclictest21322-21gltestperf07:49:361
8271992521,2cyclictest0-21swapper/012:09:220
8271992521,2cyclictest0-21swapper/012:09:220
8271992521,2cyclictest0-21swapper/011:44:420
8271992521,2cyclictest0-21swapper/011:44:420
8271992521,2cyclictest0-21swapper/008:24:450
8271992521,2cyclictest0-21swapper/008:24:450
8271992520,3cyclictest0-21swapper/008:49:390
8271992519,4cyclictest0-21swapper/011:39:450
8271992519,4cyclictest0-21swapper/011:39:450
8271992519,3cyclictest0-21swapper/011:49:430
8271992519,3cyclictest0-21swapper/011:49:430
8271992518,6cyclictest15302-21kernelversion08:59:390
8271992518,6cyclictest15302-21kernelversion08:59:390
8271992518,5cyclictest31348-21threads08:14:440
8271992517,6cyclictest1439-21sendmail08:24:220
8271992517,6cyclictest1439-21sendmail08:24:220
8278992420,3cyclictest351rcuc/208:00:262
8278992420,3cyclictest351rcuc/208:00:262
8278992419,4cyclictest351rcuc/211:12:172
8278992419,4cyclictest351rcuc/211:12:172
8278992419,3cyclictest351rcuc/209:48:232
8278992419,3cyclictest351rcuc/209:48:232
8272992420,3cyclictest25765-21gltestperf10:54:361
8272992419,3cyclictest0-21swapper/108:24:221
8272992419,3cyclictest0-21swapper/108:24:221
8272992418,5cyclictest16204-21proc_pri07:34:411
8272992418,4cyclictest29560-21gltestperf11:04:351
8272992416,5cyclictest0-21swapper/110:19:451
8272992416,5cyclictest0-21swapper/110:19:451
8272992416,5cyclictest0-21swapper/110:19:451
8271992420,3cyclictest8270-21cyclictest09:09:370
8271992420,3cyclictest8270-21cyclictest09:09:370
8271992419,3cyclictest0-21swapper/012:29:440
8271992419,3cyclictest0-21swapper/012:29:440
8271992417,4cyclictest0-21swapper/008:34:370
141532240,3sleep20-21swapper/208:54:442
8278992319,3cyclictest351rcuc/207:39:342
8278992319,3cyclictest351rcuc/207:39:342
8278992318,4cyclictest351rcuc/212:41:502
8278992318,4cyclictest351rcuc/212:41:502
8278992318,4cyclictest351rcuc/210:55:412
8278992317,4cyclictest351rcuc/208:53:162
8278992317,4cyclictest351rcuc/207:53:102
8278992317,4cyclictest351rcuc/207:53:102
8278992315,5cyclictest26602-21chrt09:29:372
8272992318,3cyclictest0-21swapper/110:39:471
8272992318,3cyclictest0-21swapper/110:39:471
8272992317,4cyclictest0-21swapper/108:04:401
8271992318,3cyclictest28637-21ntp_kernel_pll_09:34:420
8271992318,3cyclictest0-21swapper/009:59:420
8271992318,3cyclictest0-21swapper/009:59:420
8278992218,3cyclictest351rcuc/208:30:452
8278992218,3cyclictest351rcuc/208:30:452
8278992217,4cyclictest351rcuc/212:25:182
8278992217,4cyclictest351rcuc/212:25:182
8278992217,3cyclictest351rcuc/211:32:482
8278992217,3cyclictest351rcuc/211:32:482
8278992217,3cyclictest351rcuc/209:07:222
8278992217,3cyclictest351rcuc/209:07:222
8272992215,4cyclictest0-21swapper/108:49:451
8271992218,2cyclictest0-21swapper/010:29:420
8271992218,2cyclictest0-21swapper/010:29:420
8271992218,2cyclictest0-21swapper/008:09:330
8271992217,3cyclictest0-21swapper/008:04:320
314662220,3sleep30-21swapper/311:09:363
314662220,3sleep30-21swapper/311:09:363
8278992117,3cyclictest351rcuc/211:05:582
8278992117,3cyclictest351rcuc/209:36:342
8278992117,3cyclictest351rcuc/209:17:162
8278992116,4cyclictest351rcuc/210:07:332
8278992116,4cyclictest351rcuc/210:07:332
8278992115,4cyclictest351rcuc/209:54:212
8278992115,4cyclictest351rcuc/209:54:212
8271992117,2cyclictest0-21swapper/007:39:330
8271992117,2cyclictest0-21swapper/007:39:330
8271992116,3cyclictest0-21swapper/009:54:340
8278992016,3cyclictest351rcuc/212:05:082
8278992016,3cyclictest351rcuc/212:05:082
8278992016,3cyclictest351rcuc/210:11:232
8278992016,3cyclictest351rcuc/210:11:232
8278992016,3cyclictest351rcuc/209:58:162
8278992016,3cyclictest351rcuc/208:26:062
8278992016,3cyclictest351rcuc/208:26:062
161442200,4sleep20-21swapper/207:34:402
8278991915,3cyclictest351rcuc/212:33:422
8278991915,3cyclictest351rcuc/212:33:422
8278991915,3cyclictest351rcuc/209:24:442
8278991915,3cyclictest351rcuc/209:24:442
8278991914,4cyclictest351rcuc/211:38:472
8278991914,4cyclictest351rcuc/210:37:042
8278991914,4cyclictest351rcuc/210:37:042
8278991914,3cyclictest351rcuc/212:22:522
8278991914,3cyclictest351rcuc/212:22:522
8278991914,3cyclictest351rcuc/208:44:102
8278991914,3cyclictest351rcuc/208:44:102
8278991913,4cyclictest351rcuc/212:03:022
8278991913,4cyclictest351rcuc/212:03:022
8278991913,4cyclictest351rcuc/212:03:022
8278991913,4cyclictest351rcuc/211:15:262
8278991913,4cyclictest351rcuc/211:15:262
8278991814,3cyclictest351rcuc/212:14:042
8278991814,3cyclictest351rcuc/212:14:042
8278991814,3cyclictest351rcuc/211:52:012
8278991814,3cyclictest351rcuc/211:52:012
8278991814,3cyclictest351rcuc/208:18:182
8278991813,3cyclictest351rcuc/210:33:332
8278991813,3cyclictest351rcuc/210:33:332
8278991813,3cyclictest351rcuc/207:46:422
827899181,12cyclictest0-21swapper/208:34:402
8278991810,6cyclictest351rcuc/210:52:192
828099171,12cyclictest5234-21chrt08:34:223
828099171,12cyclictest5234-21chrt08:34:223
828099171,12cyclictest15050-21taskset10:24:423
828099171,12cyclictest14915-21chrt08:59:353
828099171,12cyclictest14915-21chrt08:59:353
828099171,11cyclictest9303-21taskset08:44:363
828099171,11cyclictest32469-21taskset09:44:423
828099171,11cyclictest32469-21taskset09:44:423
828099171,11cyclictest22988-21chrt10:44:483
828099171,11cyclictest18189-21taskset10:34:343
828099171,11cyclictest18189-21taskset10:34:343
8278991713,3cyclictest351rcuc/211:58:162
8278991710,5cyclictest351rcuc/210:18:022
8278991710,5cyclictest351rcuc/210:18:022
828099162,9cyclictest6862-21chrt11:29:423
828099162,9cyclictest6862-21chrt11:29:423
828099161,9cyclictest0-21swapper/307:39:323
828099161,9cyclictest0-21swapper/307:39:323
828099161,11cyclictest4438-21taskset11:24:353
828099161,11cyclictest4438-21taskset11:24:353
828099161,11cyclictest2352-21chrt08:24:423
828099161,11cyclictest2352-21chrt08:24:423
828099161,11cyclictest0-21swapper/312:24:243
828099161,11cyclictest0-21swapper/312:24:243
828099161,11cyclictest0-21swapper/312:19:263
828099161,11cyclictest0-21swapper/310:59:453
828099161,11cyclictest0-21swapper/310:59:453
828099161,10cyclictest987-21chrt11:14:383
828099161,10cyclictest987-21chrt11:14:383
827899161,11cyclictest15518-21chrt10:24:452
828099153,8cyclictest0-21swapper/311:20:233
828099153,8cyclictest0-21swapper/311:20:233
828099153,8cyclictest0-21swapper/311:20:233
828099151,9cyclictest24204-21taskset10:49:383
828099151,9cyclictest11059-21chrt08:49:343
828099151,10cyclictest8839-21taskset10:09:343
828099151,10cyclictest8839-21taskset10:09:343
828099151,10cyclictest8651-21chrt11:34:403
828099151,10cyclictest18052-21chrt09:05:463
828099151,10cyclictest18052-21chrt09:05:463
828099151,10cyclictest12454-21chrt10:19:353
828099151,10cyclictest12454-21chrt10:19:353
828099151,10cyclictest12454-21chrt10:19:353
828099150,11cyclictest27097-21chrt08:04:363
827899151,8cyclictest10999-21chrt11:39:462
827899151,8cyclictest10999-21chrt11:39:462
8278991510,4cyclictest351rcuc/211:03:532
8278991510,4cyclictest351rcuc/211:03:532
197792150,2sleep30-21swapper/312:04:393
197792150,2sleep30-21swapper/312:04:393
828099149,3cyclictest321202chrt12:39:173
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional