You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-19 - 12:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Tue May 19, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
189472630,3sleep00-21swapper/020:22:300
189472630,3sleep00-21swapper/020:22:300
247872600,3sleep20-21swapper/223:27:522
247872600,3sleep20-21swapper/223:27:522
247872600,3sleep20-21swapper/223:27:522
191492580,3sleep20-21swapper/223:12:532
191492580,3sleep20-21swapper/223:12:532
282932560,3chrt0-21swapper/222:12:432
282932560,3chrt0-21swapper/222:12:432
282932560,3chrt0-21swapper/222:12:432
179782550,2chrt0-21swapper/223:12:412
179782550,2chrt0-21swapper/223:12:412
179782550,2chrt0-21swapper/223:12:412
73622510,1sleep00-21swapper/022:42:440
73622510,1sleep00-21swapper/022:42:440
73622510,1sleep00-21swapper/022:42:440
25575995146,3cyclictest0-21swapper/000:02:340
25575995146,3cyclictest0-21swapper/000:02:340
11372500,5sleep01142-21needreboot23:52:470
11372500,5sleep01142-21needreboot23:52:470
11372500,5sleep01142-21needreboot23:52:470
79332480,4sleep20-21swapper/221:17:482
79332480,4sleep20-21swapper/221:17:482
28372480,4chrt0-21swapper/019:37:480
28372480,4chrt0-21swapper/019:37:480
319532440,2sleep10-21swapper/120:57:301
310572440,3sleep20-21swapper/219:27:412
310572440,3sleep20-21swapper/219:27:412
25212440,3chrt0-21swapper/223:57:392
25212440,3chrt0-21swapper/223:57:392
25212440,3chrt0-21swapper/223:57:392
272632420,3chrt0-21swapper/220:42:462
272632420,3chrt0-21swapper/220:42:462
58902400,2sleep05992-21memory21:12:440
58902400,2sleep05992-21memory21:12:440
132912400,3chrt0-21swapper/320:07:303
132912400,3chrt0-21swapper/320:07:303
132912400,3chrt0-21swapper/320:07:303
317322390,3sleep20-21swapper/223:47:502
317322390,3sleep20-21swapper/223:47:502
141552390,2sleep20-21swapper/220:07:452
141552390,2sleep20-21swapper/220:07:452
25576993729,6cyclictest547-21rs:main1
25576993729,6cyclictest547-21rs:main1
25575993726,9cyclictest0-21swapper/000:02:510
25575993726,9cyclictest0-21swapper/000:02:510
9472360,4sleep0773-21apache219:32:460
9472360,4sleep0773-21apache219:32:460
25576993527,5cyclictest0-21swapper/100:03:251
25576993527,5cyclictest0-21swapper/100:03:251
25575993427,5cyclictest545-21in:imuxsock21:02:300
25575993427,5cyclictest545-21in:imuxsock21:02:300
25575993427,5cyclictest545-21in:imuxsock21:02:300
189782340,3chrt0-21swapper/221:47:472
189782340,3chrt0-21swapper/221:47:472
25576993326,5cyclictest15844-21gltestperf00:32:421
25576993326,5cyclictest15844-21gltestperf00:32:421
25575993327,5cyclictest32128-21kernelversion22:22:430
25575993327,5cyclictest32128-21kernelversion22:22:430
25575993327,5cyclictest32128-21kernelversion22:22:430
25575993327,5cyclictest2796-21unixbench-2d21:02:540
25575993327,5cyclictest2796-21unixbench-2d21:02:540
25575993327,5cyclictest2796-21unixbench-2d21:02:540
253212330,3sleep00-21swapper/020:37:460
253212330,3sleep00-21swapper/020:37:460
25576993225,5cyclictest28035-21ntp_offset23:37:461
25576993225,5cyclictest28035-21ntp_offset23:37:461
25575993225,5cyclictest29542-21latency_hist22:17:290
25575993225,5cyclictest29542-21latency_hist22:17:290
25575993225,5cyclictest29542-21latency_hist22:17:290
2557999311,18cyclictest4133-21chrt00:02:353
2557999311,18cyclictest4133-21chrt00:02:353
25576993126,4cyclictest25574-21cyclictest22:32:431
25576993126,4cyclictest25574-21cyclictest22:32:431
25575993125,4cyclictest8472-21unixbench_multi21:17:540
25575993125,4cyclictest8472-21unixbench_multi21:17:540
2557899301,24cyclictest4114-21taskset00:02:342
2557899301,24cyclictest4114-21taskset00:02:342
25576993023,5cyclictest24480-21latency_hist20:37:291
25575993025,3cyclictest25574-21cyclictest23:37:450
25575993025,3cyclictest25574-21cyclictest23:37:450
25575993023,5cyclictest29313-21fschecks_count23:42:410
25575993023,5cyclictest29313-21fschecks_count23:42:410
25575993023,5cyclictest29313-21fschecks_count23:42:410
25575993023,5cyclictest12626-21threads20:02:500
25575993023,5cyclictest12626-21threads20:02:500
25575993023,5cyclictest12626-21threads20:02:500
25576992922,5cyclictest5693-21sendmail_mailqu22:37:511
25576992922,5cyclictest5693-21sendmail_mailqu22:37:511
25576992921,6cyclictest17479-21fschecks_time20:17:411
25576992921,6cyclictest17479-21fschecks_time20:17:411
25576992920,7cyclictest6541-21unixbench-2d21:12:511
25576992920,7cyclictest6541-21unixbench-2d21:12:511
25575992924,4cyclictest6803-21needreboot00:07:480
25575992924,4cyclictest6803-21needreboot00:07:480
25575992924,4cyclictest6803-21needreboot00:07:480
25575992924,3cyclictest24218-21runrttasks23:27:450
25575992924,3cyclictest24218-21runrttasks23:27:450
25575992924,3cyclictest24218-21runrttasks23:27:450
25575992922,5cyclictest11050-21sshd19:58:240
25575992922,5cyclictest11050-21sshd19:58:240
25576992824,2cyclictest0-21swapper/120:12:421
25576992824,2cyclictest0-21swapper/120:12:421
25576992823,3cyclictest18903-21gltestperf21:47:461
25576992823,3cyclictest18903-21gltestperf21:47:461
25576992820,6cyclictest1987-21cron19:37:291
25576992820,6cyclictest1987-21cron19:37:291
25576992818,8cyclictest17417-21ntp_offset21:42:461
25576992818,8cyclictest17417-21ntp_offset21:42:461
2557699281,11cyclictest92842users00:12:541
2557699281,11cyclictest92842users00:12:541
25575992822,4cyclictest0-21swapper/023:02:290
25575992822,4cyclictest0-21swapper/023:02:290
25575992821,5cyclictest8721-21sendmail_mailst19:52:500
25575992821,5cyclictest8721-21sendmail_mailst19:52:500
25575992820,6cyclictest31962-21grep19:27:500
25575992820,6cyclictest31962-21grep19:27:500
25575992820,6cyclictest14513-21threads20:07:510
25575992820,6cyclictest14513-21threads20:07:510
25575992818,8cyclictest29880-21fschecks_count22:17:430
25575992818,8cyclictest29880-21fschecks_count22:17:430
25576992722,4cyclictest13917-21gltestperf00:27:401
25576992722,4cyclictest13917-21gltestperf00:27:401
25576992722,4cyclictest13917-21gltestperf00:27:401
25576992722,3cyclictest31988-21cut22:22:421
25576992722,3cyclictest31988-21cut22:22:421
25576992722,3cyclictest31988-21cut22:22:421
25576992721,5cyclictest29995-21fschecks_time22:17:431
25576992721,5cyclictest29995-21fschecks_time22:17:431
25576992721,4cyclictest0-21swapper/123:57:401
25576992721,4cyclictest0-21swapper/123:57:401
25576992721,4cyclictest0-21swapper/123:57:401
25576992720,5cyclictest11374-21mailstats22:52:491
25576992720,5cyclictest11374-21mailstats22:52:491
25576992716,8cyclictest27727-21latency_hist22:12:321
25576992716,8cyclictest27727-21latency_hist22:12:321
25575992723,2cyclictest0-21swapper/020:52:410
25575992721,5cyclictest20826-21threads23:17:530
25575992721,5cyclictest20826-21threads23:17:530
25575992721,5cyclictest20826-21threads23:17:530
25575992721,5cyclictest12270-21kernelversion00:22:450
25575992721,5cyclictest12270-21kernelversion00:22:450
25575992721,5cyclictest12270-21kernelversion00:22:450
25575992721,4cyclictest1648-21ntpd00:22:290
25575992721,4cyclictest1648-21ntpd00:22:290
25575992720,5cyclictest32689-21latency_hist23:52:290
25575992720,5cyclictest32689-21latency_hist23:52:290
25575992719,6cyclictest12863-21/usr/sbin/munin21:32:470
25575992719,6cyclictest12863-21/usr/sbin/munin21:32:470
25575992716,8cyclictest17152-21latency_hist20:17:350
25575992716,8cyclictest17152-21latency_hist20:17:350
154222270,4sleep20-21swapper/200:32:382
154222270,4sleep20-21swapper/200:32:382
25578992619,5cyclictest351rcuc/222:10:192
25578992619,5cyclictest351rcuc/222:10:192
25578992619,5cyclictest351rcuc/221:27:582
25578992619,5cyclictest351rcuc/221:27:582
25578992619,5cyclictest351rcuc/221:27:582
25576992620,4cyclictest1648-21ntpd22:47:471
25576992620,4cyclictest1648-21ntpd22:47:471
25576992620,4cyclictest0-21swapper/100:02:301
25576992620,4cyclictest0-21swapper/100:02:301
25576992620,3cyclictest0-21swapper/100:07:431
25576992620,3cyclictest0-21swapper/100:07:431
25576992620,3cyclictest0-21swapper/100:07:431
25576992619,5cyclictest27493-21fschecks_time23:37:411
25576992619,5cyclictest27493-21fschecks_time23:37:411
25576992617,7cyclictest6155-21fschecks_count19:47:431
25576992617,7cyclictest6155-21fschecks_count19:47:431
25576992617,7cyclictest32387-21fschecks_time20:57:421
25576992617,7cyclictest32387-21fschecks_time20:57:421
25576992617,7cyclictest32387-21fschecks_time20:57:421
25576992617,7cyclictest16540-21cat00:32:501
25576992617,7cyclictest16540-21cat00:32:501
25576992617,7cyclictest16540-21cat00:32:501
25575992621,3cyclictest26160-21fschecks_count22:07:420
25575992619,5cyclictest28066-21fschecks_time22:12:420
25575992619,5cyclictest15136-21gltestperf21:37:420
25575992619,5cyclictest15136-21gltestperf21:37:420
25575992618,6cyclictest4060-21cat21:07:450
25575992618,6cyclictest4060-21cat21:07:450
25575992618,6cyclictest18787-21cut21:47:450
25575992618,6cyclictest18787-21cut21:47:450
25578992521,3cyclictest351rcuc/200:07:452
25578992521,3cyclictest351rcuc/200:07:452
25578992521,3cyclictest351rcuc/200:07:452
25578992520,3cyclictest351rcuc/222:22:372
25578992520,3cyclictest351rcuc/222:22:372
25576992520,3cyclictest0-21swapper/123:02:531
25576992520,3cyclictest0-21swapper/123:02:531
25576992519,4cyclictest0-21swapper/119:52:501
25576992519,4cyclictest0-21swapper/119:52:501
25576992518,6cyclictest25574-21cyclictest23:27:401
25576992518,6cyclictest25574-21cyclictest23:27:401
25576992518,6cyclictest25574-21cyclictest23:27:401
25576992518,5cyclictest26056-21latency_hist22:07:401
25576992518,5cyclictest26056-21latency_hist22:07:401
25576992517,6cyclictest12225-21sed21:27:511
25576992517,6cyclictest12225-21sed21:27:511
25576992517,6cyclictest12225-21sed21:27:511
25576992510,5cyclictest90-1pr/ttyS020:07:511
25576992510,5cyclictest90-1pr/ttyS020:07:511
25575992521,2cyclictest0-21swapper/022:02:530
25575992520,4cyclictest19024-21latency_hist00:42:310
25575992520,4cyclictest19024-21latency_hist00:42:310
25575992520,3cyclictest18616-21needreboot23:12:460
25575992520,3cyclictest18616-21needreboot23:12:460
25575992519,5cyclictest4997-21fschecks_time22:37:420
25575992519,5cyclictest4997-21fschecks_time22:37:420
25575992518,5cyclictest21468-21kernelversion20:27:430
25575992518,5cyclictest21468-21kernelversion20:27:430
25575992517,6cyclictest11182-21ntp_kernel_pll_22:52:470
25575992517,6cyclictest11182-21ntp_kernel_pll_22:52:470
25575992516,7cyclictest15313-21cat23:02:530
25575992516,7cyclictest15313-21cat23:02:530
25575992516,7cyclictest10276-21latency_hist22:52:310
25575992516,7cyclictest10276-21latency_hist22:52:310
25578992420,3cyclictest351rcuc/223:19:532
25578992420,3cyclictest351rcuc/223:19:532
25578992420,3cyclictest351rcuc/223:19:532
25578992419,3cyclictest351rcuc/222:59:312
25578992419,3cyclictest351rcuc/222:59:312
25578992419,3cyclictest351rcuc/221:05:392
25578992419,3cyclictest351rcuc/221:05:392
25578992419,3cyclictest351rcuc/221:05:392
25578992418,4cyclictest351rcuc/220:16:302
25578992418,4cyclictest351rcuc/220:16:302
25576992419,3cyclictest19777-21strings20:22:431
25576992419,3cyclictest19777-21strings20:22:431
25576992419,3cyclictest0-21swapper/120:37:511
25576992419,3cyclictest0-21swapper/120:37:511
25576992419,3cyclictest0-21swapper/119:27:291
25576992419,3cyclictest0-21swapper/119:27:291
25576992418,3cyclictest0-21swapper/123:42:491
25576992418,3cyclictest0-21swapper/123:42:491
25576992418,3cyclictest0-21swapper/123:42:491
25576992417,5cyclictest28689-21processes22:12:491
25576992417,5cyclictest28689-21processes22:12:491
25576992417,5cyclictest28689-21processes22:12:491
25576992417,5cyclictest13172-21rt-features22:57:511
25576992417,5cyclictest13172-21rt-features22:57:511
25576992417,4cyclictest0-21swapper/121:07:431
25576992417,4cyclictest0-21swapper/121:07:431
25576992415,7cyclictest21134-21tr21:52:461
25576992415,7cyclictest21134-21tr21:52:461
25575992420,3cyclictest4449-21gltestperf19:42:450
25575992420,3cyclictest4449-21gltestperf19:42:450
25575992420,3cyclictest4449-21gltestperf19:42:450
25575992419,3cyclictest0-21swapper/000:17:290
25575992419,3cyclictest0-21swapper/000:17:290
25575992418,3cyclictest0-21swapper/023:32:450
25575992418,3cyclictest0-21swapper/023:32:450
25575992418,3cyclictest0-21swapper/023:32:450
25575992417,4cyclictest0-21swapper/021:57:420
25575992417,4cyclictest0-21swapper/021:57:420
25575992417,4cyclictest0-21swapper/021:57:420
25575992416,6cyclictest1334-21fschecks_time22:27:420
25575992414,8cyclictest14678-21systemd-journal00:32:290
25575992414,8cyclictest14678-21systemd-journal00:32:290
25578992319,3cyclictest351rcuc/223:05:542
25578992319,3cyclictest351rcuc/223:05:542
25578992318,4cyclictest351rcuc/222:02:032
25578992318,4cyclictest351rcuc/222:02:032
25578992318,4cyclictest351rcuc/222:02:032
25578992318,4cyclictest351rcuc/220:35:002
25578992318,4cyclictest351rcuc/219:53:352
25578992318,4cyclictest351rcuc/219:53:352
25578992318,3cyclictest351rcuc/219:38:402
25578992318,3cyclictest351rcuc/219:38:402
25576992319,2cyclictest0-21swapper/121:27:401
25576992319,2cyclictest0-21swapper/121:27:401
2557699231,8cyclictest20116-21gltestperf23:17:441
2557699231,8cyclictest20116-21gltestperf23:17:441
2557699231,8cyclictest20116-21gltestperf23:17:441
25576992318,3cyclictest26880-21gltestperf20:42:431
25576992318,3cyclictest26880-21gltestperf20:42:431
25576992318,3cyclictest0-21swapper/123:47:551
25576992318,3cyclictest0-21swapper/123:47:551
25576992318,3cyclictest0-21swapper/123:07:511
25576992318,3cyclictest0-21swapper/123:07:511
25576992318,3cyclictest0-21swapper/123:07:511
25576992318,3cyclictest0-21swapper/121:17:521
25576992318,3cyclictest0-21swapper/121:17:521
25576992317,4cyclictest24293-21ntp_kernel_pll_23:27:481
25576992317,4cyclictest24293-21ntp_kernel_pll_23:27:481
25576992317,4cyclictest24293-21ntp_kernel_pll_23:27:481
25576992315,6cyclictest7015-21head22:42:411
25576992315,6cyclictest7015-21head22:42:411
25576992315,6cyclictest7015-21head22:42:411
25576992312,9cyclictest14677-21latency_hist21:37:351
25576992312,9cyclictest14677-21latency_hist21:37:351
25575992319,2cyclictest0-21swapper/023:22:410
25575992319,2cyclictest0-21swapper/023:22:410
25575992319,2cyclictest0-21swapper/023:22:410
25575992318,4cyclictest28509-21cpuspeed20:47:400
25575992318,3cyclictest0-21swapper/021:52:480
25575992318,3cyclictest0-21swapper/021:52:480
25575992317,4cyclictest0-21swapper/021:27:490
25575992317,4cyclictest0-21swapper/021:27:490
25575992317,4cyclictest0-21swapper/021:27:490
25575992317,3cyclictest0-21swapper/021:42:440
25575992317,3cyclictest0-21swapper/021:42:440
25575992316,5cyclictest19346-21cut20:22:390
25575992316,5cyclictest19346-21cut20:22:390
25575992316,4cyclictest0-21swapper/019:47:520
25575992316,4cyclictest0-21swapper/019:47:520
25578992218,3cyclictest351rcuc/222:42:072
25578992218,3cyclictest351rcuc/222:42:072
25578992218,3cyclictest351rcuc/221:09:372
25578992218,3cyclictest351rcuc/221:09:372
25578992217,4cyclictest351rcuc/220:26:522
25578992217,4cyclictest351rcuc/220:26:522
25578992217,3cyclictest351rcuc/223:22:432
25578992217,3cyclictest351rcuc/223:22:432
25578992217,3cyclictest351rcuc/223:22:432
25578992216,5cyclictest351rcuc/200:35:152
25578992216,5cyclictest351rcuc/200:35:152
25578992216,5cyclictest351rcuc/200:35:152
25576992218,2cyclictest0-21swapper/121:22:511
25576992218,2cyclictest0-21swapper/119:42:521
25576992218,2cyclictest0-21swapper/119:42:521
25576992218,2cyclictest0-21swapper/119:42:521
25576992217,3cyclictest0-21swapper/121:02:451
25576992217,3cyclictest0-21swapper/121:02:451
25576992217,3cyclictest0-21swapper/121:02:451
25576992216,4cyclictest0-21swapper/121:57:491
25576992216,4cyclictest0-21swapper/121:57:491
25576992216,4cyclictest0-21swapper/121:57:491
25576992216,4cyclictest0-21swapper/120:47:511
25576992216,4cyclictest0-21swapper/120:47:511
25576992216,4cyclictest0-21swapper/120:47:511
25576992214,6cyclictest31196-21gltestperf19:27:421
25576992214,6cyclictest31196-21gltestperf19:27:421
25576992214,6cyclictest25783-21sed23:32:431
2557699221,18cyclictest10630-21ntp_states00:17:491
2557699221,18cyclictest10630-21ntp_states00:17:491
25575992218,2cyclictest0-21swapper/022:32:460
25575992218,2cyclictest0-21swapper/022:32:460
25575992216,4cyclictest0-21swapper/020:42:440
25578992117,3cyclictest351rcuc/221:33:122
25578992117,3cyclictest351rcuc/221:33:122
25578992117,3cyclictest351rcuc/220:28:282
25578992117,3cyclictest351rcuc/220:28:282
25578992117,3cyclictest351rcuc/200:18:352
25578992117,3cyclictest351rcuc/200:18:352
25578992116,4cyclictest351rcuc/221:41:412
25578992116,4cyclictest351rcuc/221:41:412
25578992116,3cyclictest351rcuc/200:27:392
25578992116,3cyclictest351rcuc/200:27:392
25578992116,3cyclictest351rcuc/200:27:392
25578992115,4cyclictest351rcuc/221:56:242
25578992115,4cyclictest351rcuc/221:56:242
25578992115,4cyclictest351rcuc/219:43:582
25578992115,4cyclictest351rcuc/219:43:582
25578992115,4cyclictest351rcuc/219:43:582
25576992116,3cyclictest0-21swapper/120:27:411
25576992116,3cyclictest0-21swapper/120:27:411
25576992116,3cyclictest0-21swapper/119:37:451
25576992116,3cyclictest0-21swapper/119:37:451
25576992116,3cyclictest0-21swapper/100:37:531
25576992116,3cyclictest0-21swapper/100:37:531
25576992115,5cyclictest25574-21cyclictest22:27:461
25576992114,4cyclictest0-21swapper/123:12:451
25576992114,4cyclictest0-21swapper/123:12:451
25575992116,3cyclictest0-21swapper/021:22:410
25575992116,3cyclictest0-21swapper/021:22:410
25575992116,3cyclictest0-21swapper/021:22:410
25575992116,3cyclictest0-21swapper/019:22:410
25575992116,3cyclictest0-21swapper/019:22:410
25575992116,3cyclictest0-21swapper/000:32:440
25575992116,3cyclictest0-21swapper/000:32:440
25575992116,3cyclictest0-21swapper/000:32:440
25575992115,4cyclictest0-21swapper/023:07:440
25575992115,4cyclictest0-21swapper/023:07:440
25575992115,4cyclictest0-21swapper/023:07:440
25575992115,4cyclictest0-21swapper/020:32:420
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional