You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-30 - 20:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Sat May 30, 2026 12:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
246321140,1sleep0171ktimers/012:12:580
258832960,2sleep2351rcuc/211:48:002
258832960,2sleep2351rcuc/211:48:002
258832960,2sleep2351rcuc/211:48:002
16392830,3sleep20-21swapper/207:52:552
16392830,3sleep20-21swapper/207:52:552
63502730,18sleep16500-21if_wlan010:57:551
327382690,3chrt0-21swapper/307:47:573
327382690,3chrt0-21swapper/307:47:573
211192650,3chrt0-21swapper/211:37:512
211192650,3chrt0-21swapper/211:37:512
227762620,2sleep016-21ksoftirqd/010:13:030
104182580,3sleep30-21swapper/311:07:573
104182580,3sleep30-21swapper/311:07:573
98222570,3chrt0-21swapper/211:07:522
253562500,3chrt0-21swapper/307:27:593
253562500,3chrt0-21swapper/307:27:593
49242480,2sleep10-21swapper/109:27:531
49242480,2sleep10-21swapper/109:27:531
49242480,2sleep10-21swapper/109:27:531
42672460,2sleep04274-21netstat12:17:570
42672460,2sleep04274-21netstat12:17:570
42672460,2sleep04274-21netstat12:17:570
18987994418,11cyclictest31850-21taskset12:05:060
18987994418,11cyclictest31850-21taskset12:05:060
142412440,4chrt0-21swapper/309:52:523
142412440,4chrt0-21swapper/309:52:523
48262430,2sleep30-21swapper/310:52:593
48262430,2sleep30-21swapper/310:52:593
240702420,3sleep30-21swapper/310:17:563
240702420,3sleep30-21swapper/310:17:563
234882420,3sleep10-21swapper/107:22:591
234882420,3sleep10-21swapper/107:22:591
18987994216,12cyclictest29993-21taskset12:00:270
18987994216,12cyclictest29993-21taskset12:00:270
18987994216,12cyclictest29993-21taskset12:00:270
18987994215,12cyclictest8482-21chrt08:08:490
18987994215,12cyclictest8482-21chrt08:08:490
18987994214,11cyclictest19671-21users08:38:030
18987994214,11cyclictest19671-21users08:38:030
18987994117,10cyclictest22488-21taskset11:40:010
18987994117,10cyclictest22488-21taskset11:40:010
18987994114,12cyclictest24192-21taskset07:25:170
18987994114,12cyclictest24192-21taskset07:25:170
18987994114,12cyclictest21070-21chrt10:08:160
18987994114,12cyclictest21070-21chrt10:08:160
272322400,5sleep0201rcuc/010:27:500
272322400,5sleep0201rcuc/010:27:500
18987994015,11cyclictest6704-21taskset08:04:540
18987994015,11cyclictest6704-21taskset08:04:540
18987994015,11cyclictest6704-21taskset08:04:540
18987994014,12cyclictest5799-21taskset10:57:240
18987994014,12cyclictest5799-21taskset10:57:240
18987994014,10cyclictest12504-21taskset08:22:140
18987994014,10cyclictest12504-21taskset08:22:140
18987994010,15cyclictest0-21swapper/010:22:140
18987994010,15cyclictest0-21swapper/010:22:140
174972400,2sleep30-21swapper/311:27:513
174972400,2sleep30-21swapper/311:27:513
18987993916,8cyclictest26056-21taskset07:30:200
18987993916,8cyclictest26056-21taskset07:30:200
18987993916,13cyclictest13278-21chrt11:17:110
18987993916,13cyclictest13278-21chrt11:17:110
18987993916,13cyclictest13278-21chrt11:17:110
18987993915,8cyclictest17552-21taskset10:01:210
18987993915,8cyclictest17552-21taskset10:01:210
18987993915,8cyclictest11854-21taskset09:45:520
18987993915,8cyclictest11854-21taskset09:45:520
18987993915,10cyclictest19310-21taskset10:04:340
18987993915,10cyclictest19310-21taskset10:04:340
18987993914,9cyclictest8066-21taskset09:35:390
18987993914,9cyclictest8066-21taskset09:35:390
18987993914,9cyclictest8066-21taskset09:35:390
18987993914,9cyclictest8066-21taskset09:35:390
18987993913,13cyclictest30992-21chrt09:09:150
18987993913,13cyclictest30992-21chrt09:09:150
18987993913,13cyclictest30992-21chrt09:09:150
18987993913,12cyclictest27165-21taskset08:58:120
18987993913,12cyclictest27165-21taskset08:58:120
18987993912,8cyclictest0-21swapper/009:03:190
18987993912,8cyclictest0-21swapper/009:03:190
18987993912,8cyclictest0-21swapper/009:03:190
18987993912,11cyclictest9333-21taskset11:04:160
18987993912,11cyclictest9333-21taskset11:04:160
18987993912,10cyclictest749-21runrttasks08:25:330
18987993912,10cyclictest749-21runrttasks08:25:330
50222380,2sleep2351rcuc/208:02:402
50222380,2sleep2351rcuc/208:02:402
318202380,1sleep2351rcuc/209:12:552
318202380,1sleep2351rcuc/209:12:552
318202380,1sleep2351rcuc/209:12:552
18987993818,7cyclictest10491-21taskset08:15:230
18987993818,7cyclictest10491-21taskset08:15:230
18987993814,11cyclictest2286-21taskset09:18:510
18987993814,11cyclictest2286-21taskset09:18:510
18987993814,11cyclictest2286-21taskset09:18:510
18987993814,11cyclictest2286-21taskset09:18:510
18987993814,10cyclictest24246-21seq11:43:240
18987993814,10cyclictest24246-21seq11:43:240
18987993814,10cyclictest24246-21seq11:43:240
18987993813,8cyclictest332-21chrt09:13:130
18987993813,8cyclictest332-21chrt09:13:130
18987993813,8cyclictest332-21chrt09:13:130
18987993813,7cyclictest0-21swapper/012:24:430
18987993813,7cyclictest0-21swapper/012:24:430
18987993813,7cyclictest0-21swapper/009:38:120
18987993813,7cyclictest0-21swapper/009:38:120
18987993813,12cyclictest14858-21taskset11:18:110
18987993813,12cyclictest14858-21taskset11:18:110
18987993813,12cyclictest14858-21taskset11:18:110
18987993813,11cyclictest749-21runrttasks11:31:260
18987993813,11cyclictest23506-21taskset08:49:010
18987993813,11cyclictest23506-21taskset08:49:010
18987993813,11cyclictest20596-21chrt11:34:350
18987993813,11cyclictest20596-21chrt11:34:350
18987993812,13cyclictest28590-21chrt10:28:500
18987993812,13cyclictest28590-21chrt10:28:500
18987993812,13cyclictest28590-21chrt10:28:500
18987993812,12cyclictest32493-21taskset10:41:090
18987993812,12cyclictest32493-21taskset10:41:090
18987993812,12cyclictest3066-21chrt07:56:390
18987993812,12cyclictest3066-21chrt07:56:390
18987993812,11cyclictest25313-21taskset08:53:190
18987993812,11cyclictest11127-21chrt11:08:260
18987993812,11cyclictest11127-21chrt11:08:260
260392370,3sleep20-21swapper/208:57:512
260392370,3sleep20-21swapper/208:57:512
246822370,3sleep30-21swapper/308:52:583
18987993715,10cyclictest27972-21taskset11:53:250
18987993715,10cyclictest27972-21taskset11:53:250
18987993714,10cyclictest1802-21chrt10:44:100
18987993714,10cyclictest1802-21chrt10:44:100
18987993713,12cyclictest12462-21seq12:39:040
18987993713,12cyclictest12462-21seq12:39:040
18987993713,12cyclictest12462-21seq12:39:040
18987993713,11cyclictest16019-21seq08:28:550
18987993713,11cyclictest16019-21seq08:28:550
18987993713,11cyclictest1136-21taskset07:50:550
18987993713,11cyclictest1136-21taskset07:50:550
18987993713,10cyclictest4403-21chrt09:26:480
18987993713,10cyclictest4403-21chrt09:26:480
18987993713,10cyclictest4403-21chrt09:26:480
18987993712,11cyclictest7516-21chrt11:00:300
18987993711,11cyclictest17827-21taskset08:33:130
18987993711,11cyclictest17827-21taskset08:33:130
18987993613,8cyclictest31550-21seq07:43:520
18987993613,8cyclictest31550-21seq07:43:520
18987993613,8cyclictest31550-21seq07:43:520
18987993613,8cyclictest29773-21strings10:32:550
18987993613,8cyclictest29773-21strings10:32:550
18987993613,8cyclictest29773-21strings10:32:550
18987993612,8cyclictest16785-21chrt11:23:380
18987993612,8cyclictest16785-21chrt11:23:380
18987993612,8cyclictest16785-21chrt11:23:380
18987993612,10cyclictest15673-21chrt09:56:060
18987993612,10cyclictest15673-21chrt09:56:060
18987993611,11cyclictest4818-21chrt08:00:120
18987993611,11cyclictest4818-21chrt08:00:120
18987993611,10cyclictest749-21runrttasks12:34:290
18987993611,10cyclictest749-21runrttasks12:34:290
18987993522,10cyclictest27530-21sed07:33:020
18987993522,10cyclictest27530-21sed07:33:020
18987993514,8cyclictest3755-21taskset10:50:210
18987993514,8cyclictest3755-21taskset10:50:210
18987993512,8cyclictest13859-21taskset09:51:460
18987993512,8cyclictest13859-21taskset09:51:460
18987993512,11cyclictest5990-21/usr/sbin/munin09:28:030
18987993512,11cyclictest5990-21/usr/sbin/munin09:28:030
18987993512,11cyclictest5990-21/usr/sbin/munin09:28:030
18987993512,11cyclictest5990-21/usr/sbin/munin09:28:030
18988993425,7cyclictest464-21needreboot12:07:571
18988993425,7cyclictest464-21needreboot12:07:571
18987993412,11cyclictest749-21runrttasks07:38:330
18987993411,8cyclictest26386-21taskset11:52:000
18987993411,8cyclictest26386-21taskset11:52:000
18987993411,8cyclictest26386-21taskset11:52:000
18987993411,8cyclictest1185-21taskset12:08:520
18987993411,8cyclictest1185-21taskset12:08:520
18987993410,8cyclictest21807-21seq08:46:070
18987993410,8cyclictest21807-21seq08:46:070
18987993326,5cyclictest7596-21fschecks_time12:27:530
18987993326,5cyclictest7596-21fschecks_time12:27:530
63992320,2sleep16401-21mailstats12:23:011
63992320,2sleep16401-21mailstats12:23:011
18988993223,7cyclictest8533-21fschecks_count09:37:531
18988993223,7cyclictest8533-21fschecks_count09:37:531
18988993223,7cyclictest8533-21fschecks_count09:37:531
18988993223,7cyclictest8533-21fschecks_count09:37:531
1898999311,25cyclictest0-21swapper/210:01:392
1898999311,25cyclictest0-21swapper/210:01:392
18988993123,6cyclictest9803-21/usr/sbin/munin11:07:591
18988993123,6cyclictest9803-21/usr/sbin/munin11:07:591
18988993123,6cyclictest31781-21gltestperf09:12:541
18988993123,6cyclictest31781-21gltestperf09:12:541
18988993123,6cyclictest31781-21gltestperf09:12:541
18988993122,7cyclictest18356-21latency_hist08:37:471
18988993122,7cyclictest18356-21latency_hist08:37:471
18988993122,6cyclictest25884-21kernelversion10:22:571
18988993122,6cyclictest25884-21kernelversion10:22:571
18988993122,6cyclictest20462-21fschecks_count08:42:511
18988993122,6cyclictest20462-21fschecks_count08:42:511
115192310,2sleep20-21swapper/208:17:552
115192310,2sleep20-21swapper/208:17:552
18988993023,6cyclictest18986-21cyclictest10:27:531
18988993023,6cyclictest18986-21cyclictest10:27:531
18988993023,6cyclictest18986-21cyclictest10:27:531
18988993022,5cyclictest14646-21kernelversion09:52:551
18988993022,5cyclictest14646-21kernelversion09:52:551
18988992924,3cyclictest5605-21systemctl09:28:011
18988992924,3cyclictest5605-21systemctl09:28:011
18988992924,3cyclictest5605-21systemctl09:28:011
18988992924,3cyclictest5605-21systemctl09:28:011
18988992923,4cyclictest773-21apache212:28:031
18988992923,4cyclictest773-21apache212:28:031
18988992921,6cyclictest27520-21ls07:33:021
18988992921,6cyclictest27520-21ls07:33:021
238452280,2sleep123844-21mailstats11:43:011
238452280,2sleep123844-21mailstats11:43:011
238452280,2sleep123844-21mailstats11:43:011
238152280,2sleep10-21swapper/108:52:401
238152280,2sleep10-21swapper/108:52:401
1898999281,19cyclictest0-21swapper/211:37:272
1898999281,19cyclictest0-21swapper/211:37:272
18988992823,3cyclictest0-21swapper/109:13:021
18988992823,3cyclictest0-21swapper/109:13:021
18988992823,3cyclictest0-21swapper/109:13:021
18988992822,4cyclictest26364-21latency_hist07:32:451
18988992822,4cyclictest26364-21latency_hist07:32:451
18988992822,4cyclictest18986-21cyclictest10:05:081
18988992822,4cyclictest18986-21cyclictest10:05:081
18988992822,4cyclictest14678-21systemd-journal11:40:011
18988992822,4cyclictest14678-21systemd-journal11:40:011
18988992821,5cyclictest30459-21fschecks_time07:42:521
18988992821,5cyclictest30459-21fschecks_time07:42:521
18988992821,5cyclictest30459-21fschecks_time07:42:521
18988992821,5cyclictest22827-21unixbench_multi10:13:031
1898999271,21cyclictest500-21chrt10:42:512
1898999271,21cyclictest500-21chrt10:42:512
1898999271,21cyclictest29838-21chrt07:41:052
1898999271,21cyclictest24170-21chrt07:25:012
1898999271,21cyclictest24170-21chrt07:25:012
1898999271,20cyclictest0-21swapper/212:19:562
1898999271,20cyclictest0-21swapper/212:19:562
1898999271,20cyclictest0-21swapper/212:19:562
1898999271,19cyclictest0-21swapper/207:52:482
1898999271,19cyclictest0-21swapper/207:52:482
1898999271,18cyclictest0-21swapper/207:29:072
1898999271,18cyclictest0-21swapper/207:29:072
18988992723,2cyclictest0-21swapper/111:22:401
18988992723,2cyclictest0-21swapper/111:22:401
18988992723,2cyclictest0-21swapper/111:22:401
18988992723,2cyclictest0-21swapper/110:08:011
18988992723,2cyclictest0-21swapper/110:08:011
18988992722,3cyclictest0-21swapper/111:17:411
18988992722,3cyclictest0-21swapper/111:17:411
18988992722,3cyclictest0-21swapper/111:17:411
18988992720,5cyclictest4522-21head10:52:541
18988992720,5cyclictest4522-21head10:52:541
18988992720,5cyclictest2772-21latency_hist09:22:511
18988992720,5cyclictest2772-21latency_hist09:22:511
18988992720,5cyclictest2772-21latency_hist09:22:511
18988992720,5cyclictest2772-21latency_hist09:22:511
18988992720,4cyclictest545-21in:imuxsock07:53:011
18988992720,4cyclictest545-21in:imuxsock07:53:011
18988992717,8cyclictest17790-21latency_hist10:02:451
18988992717,8cyclictest17790-21latency_hist10:02:451
18988992717,8cyclictest11778-21needreboot12:37:571
18988992717,8cyclictest11778-21needreboot12:37:571
18988992717,8cyclictest11778-21needreboot12:37:571
1898999261,21cyclictest0-21swapper/210:35:402
1898999261,21cyclictest0-21swapper/210:35:402
1898999261,21cyclictest0-21swapper/210:35:402
1898999261,20cyclictest28063-21chrt11:54:352
1898999261,20cyclictest28063-21chrt11:54:352
1898999261,20cyclictest27489-21taskset10:27:522
1898999261,20cyclictest27489-21taskset10:27:522
1898999261,20cyclictest27489-21taskset10:27:522
1898999261,20cyclictest21259-21chrt10:10:432
1898999261,20cyclictest21259-21chrt10:10:432
1898999261,20cyclictest0-21swapper/209:27:232
1898999261,20cyclictest0-21swapper/209:27:232
1898999261,20cyclictest0-21swapper/209:27:232
1898999261,19cyclictest19771-21chrt08:39:102
1898999261,19cyclictest19771-21chrt08:39:102
1898999261,19cyclictest0-21swapper/209:47:242
1898999261,19cyclictest0-21swapper/209:47:242
1898999260,22cyclictest10588-21chrt12:33:552
1898999260,22cyclictest10588-21chrt12:33:552
1898999260,21cyclictest16194-21chrt08:31:102
1898999260,21cyclictest16194-21chrt08:31:102
18988992621,4cyclictest18986-21cyclictest08:37:521
18988992621,4cyclictest18986-21cyclictest08:37:521
18988992621,3cyclictest0-21swapper/110:18:031
18988992621,3cyclictest0-21swapper/110:18:031
18988992619,5cyclictest8300-21head11:02:531
18988992619,5cyclictest8300-21head11:02:531
18988992618,6cyclictest19295-21ls11:32:511
18988992618,6cyclictest19295-21ls11:32:511
226112250,2sleep30-21swapper/310:13:023
1898999252,19cyclictest13934-21chrt11:17:532
1898999252,19cyclictest13934-21chrt11:17:532
1898999252,19cyclictest13934-21chrt11:17:532
1898999251,20cyclictest11591-21chrt11:12:462
1898999251,20cyclictest11591-21chrt11:12:462
1898999251,19cyclictest8864-21chrt12:31:012
1898999251,19cyclictest8864-21chrt12:31:012
1898999251,19cyclictest31538-21chrt07:43:422
1898999251,19cyclictest31538-21chrt07:43:422
1898999251,19cyclictest31538-21chrt07:43:422
1898999251,17cyclictest0-21swapper/209:33:182
1898999251,17cyclictest0-21swapper/209:33:182
1898999251,17cyclictest0-21swapper/209:33:182
1898999251,17cyclictest0-21swapper/209:33:182
18988992520,4cyclictest11546-21needreboot08:17:571
18988992520,4cyclictest11546-21needreboot08:17:571
18988992520,3cyclictest0-21swapper/110:48:021
18988992520,3cyclictest0-21swapper/110:48:021
18988992519,3cyclictest0-21swapper/112:07:521
18988992519,3cyclictest0-21swapper/112:07:521
18988992517,6cyclictest2571-21grep12:13:001
18988992516,7cyclictest31219-21cut10:37:541
18988992516,7cyclictest31219-21cut10:37:541
1898999248,13cyclictest0-21swapper/210:27:382
1898999248,13cyclictest0-21swapper/210:27:382
18989992416,5cyclictest0-21swapper/212:05:342
18989992416,5cyclictest0-21swapper/212:05:342
1898999241,19cyclictest6108-21chrt09:29:232
1898999241,19cyclictest6108-21chrt09:29:232
1898999241,19cyclictest6108-21chrt09:29:232
1898999241,19cyclictest6108-21chrt09:29:232
1898999241,19cyclictest3481-21chrt10:48:022
1898999241,19cyclictest3481-21chrt10:48:022
1898999241,19cyclictest24303-21chrt11:44:062
1898999241,19cyclictest24303-21chrt11:44:062
1898999241,19cyclictest24303-21chrt11:44:062
1898999241,19cyclictest168872sleep211:24:572
1898999241,19cyclictest168872sleep211:24:572
1898999241,19cyclictest168872sleep211:24:572
1898999241,18cyclictest6914-21chrt12:24:542
1898999241,18cyclictest6914-21chrt12:24:542
1898999241,18cyclictest6852-21chrt08:06:502
1898999241,18cyclictest6852-21chrt08:06:502
1898999241,18cyclictest6852-21chrt08:06:502
1898999241,18cyclictest29867-21chrt11:58:492
1898999241,18cyclictest29867-21chrt11:58:492
1898999241,18cyclictest29867-21chrt11:58:492
1898999241,18cyclictest27860-21chrt09:02:502
1898999241,18cyclictest27860-21chrt09:02:502
1898999241,18cyclictest27860-21chrt09:02:502
1898999241,18cyclictest17819-21chrt08:33:072
1898999241,18cyclictest17819-21chrt08:33:072
1898999240,18cyclictest1259-21taskset12:09:512
1898999240,18cyclictest1259-21taskset12:09:512
18988992419,3cyclictest0-21swapper/107:58:021
18988992419,3cyclictest0-21swapper/107:58:021
18988992418,5cyclictest7136-21latency_hist08:07:501
18988992417,5cyclictest26597-21awk08:57:571
18988992417,5cyclictest26597-21awk08:57:571
18988992417,5cyclictest1-21systemd09:43:011
18988992417,5cyclictest1-21systemd09:43:011
18988992417,4cyclictest0-21swapper/110:32:561
18988992417,4cyclictest0-21swapper/110:32:561
18988992417,4cyclictest0-21swapper/110:32:561
9592230,1sleep1961-21sed10:42:551
9592230,1sleep1961-21sed10:42:551
296302230,2sleep10-21swapper/109:07:511
296302230,2sleep10-21swapper/109:07:511
296302230,2sleep10-21swapper/109:07:511
1898999231,18cyclictest5634-21chrt10:55:142
1898999231,18cyclictest5634-21chrt10:55:142
1898999231,18cyclictest3078-21chrt12:14:092
1898999231,18cyclictest24818-21chrt10:18:352
1898999231,18cyclictest24818-21chrt10:18:352
1898999231,18cyclictest2388-21chrt09:20:022
1898999231,18cyclictest2388-21chrt09:20:022
1898999231,18cyclictest2388-21chrt09:20:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional