You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-31 - 15:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Sun May 31, 2026 12:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2155021080,6sleep0171ktimers/007:33:030
2155021080,6sleep0171ktimers/007:33:030
2934121070,3sleep00-21swapper/009:22:490
71612900,3sleep00-21swapper/009:48:020
71612900,3sleep00-21swapper/009:48:020
18602820,4chrt0-21swapper/309:33:013
18602820,4chrt0-21swapper/309:33:013
80232710,2sleep08025-21grep08:23:030
80232710,2sleep08025-21grep08:23:030
254272710,3chrt0-21swapper/312:03:003
254272710,3chrt0-21swapper/312:03:003
195942710,3sleep20-21swapper/207:28:022
195942710,3sleep20-21swapper/207:28:022
195942710,3sleep20-21swapper/207:28:022
138622700,3sleep30-21swapper/311:32:573
138622700,3sleep30-21swapper/311:32:573
138622700,3sleep30-21swapper/311:32:573
289002690,4chrt0-21swapper/007:53:000
289002690,4chrt0-21swapper/007:53:000
278052680,3sleep027806-21ls07:52:400
278052680,3sleep027806-21ls07:52:400
13752670,3sleep20-21swapper/208:07:542
13752670,3sleep20-21swapper/208:07:542
13752670,3sleep20-21swapper/208:07:542
265862610,3sleep20-21swapper/207:47:562
265862610,3sleep20-21swapper/207:47:562
232172580,3chrt23220-21wc07:38:010
125752540,3sleep0201rcuc/011:28:040
125752540,3sleep0201rcuc/011:28:040
274492490,3sleep20-21swapper/212:08:062
274492490,3sleep20-21swapper/212:08:062
274492490,3sleep20-21swapper/212:08:062
13200994919,12cyclictest20176-21taskset11:48:541
14322470,3chrt0-21swapper/312:27:523
14322470,3chrt0-21swapper/312:27:523
13200994720,17cyclictest12204-21seq08:37:191
206912460,4sleep20-21swapper/211:52:502
13200994532,11cyclictest11460-21sshd10:00:061
13200994532,11cyclictest11460-21sshd10:00:061
13200994521,10cyclictest9139-21taskset11:21:401
13200994520,7cyclictest1283-21/usr/sbin/munin09:32:551
13200994520,7cyclictest1283-21/usr/sbin/munin09:32:551
13200994520,16cyclictest7246-21taskset11:16:451
13200994520,16cyclictest7246-21taskset11:16:451
112722450,1sleep0171ktimers/008:33:000
13200994420,14cyclictest6463-21taskset08:20:541
13200994420,14cyclictest6463-21taskset08:20:541
13200994419,8cyclictest26070-21date07:47:461
13200994419,8cyclictest26070-21date07:47:461
13200994419,8cyclictest26070-21date07:47:461
13200994417,11cyclictest21294-21runrttasks08:58:411
125892440,3sleep20-21swapper/208:37:532
125892440,3sleep20-21swapper/208:37:532
301822430,3sleep00-21swapper/009:23:010
301822430,3sleep00-21swapper/009:23:010
301822430,3sleep00-21swapper/009:23:010
291372430,3sleep30-21swapper/310:47:553
291372430,3sleep30-21swapper/310:47:553
291372430,3sleep30-21swapper/310:47:553
233032430,3sleep1281ktimers/110:32:531
233032430,3sleep1281ktimers/110:32:531
13200994321,5cyclictest28154-21users10:43:041
13200994321,5cyclictest28154-21users10:43:041
13200994319,8cyclictest17243-21if_err_wlan007:22:531
13200994319,8cyclictest17243-21if_err_wlan007:22:531
13200994318,7cyclictest16620-21chrt11:41:191
13200994318,7cyclictest16620-21chrt11:41:191
13200994318,12cyclictest872-21taskset12:24:321
13200994318,12cyclictest872-21taskset12:24:321
13200994318,11cyclictest27608-21taskset12:08:261
13200994318,11cyclictest27608-21taskset12:08:261
13200994318,11cyclictest27608-21taskset12:08:261
13200994318,11cyclictest1585-21seq11:01:301
13200994318,11cyclictest1585-21seq11:01:301
13200994317,10cyclictest18983-21seq10:20:141
13200994317,10cyclictest18983-21seq10:20:141
13200994233,7cyclictest0-21swapper/110:55:081
13200994233,7cyclictest0-21swapper/110:55:081
13200994231,9cyclictest0-21swapper/111:11:561
13200994231,9cyclictest0-21swapper/111:11:561
13200994221,8cyclictest13868-21cat11:32:571
13200994221,8cyclictest13868-21cat11:32:571
13200994221,8cyclictest13868-21cat11:32:571
13200994221,7cyclictest19615-21seq08:56:041
13200994221,7cyclictest19615-21seq08:56:041
13200994220,5cyclictest20688-21users10:23:041
13200994220,5cyclictest20688-21users10:23:041
13200994220,10cyclictest17007-21taskset10:13:501
13200994220,10cyclictest17007-21taskset10:13:501
13200994220,10cyclictest17007-21taskset10:13:501
13200994217,11cyclictest749-21runrttasks09:17:021
13200994216,7cyclictest0-21swapper/109:40:251
13200994216,7cyclictest0-21swapper/109:40:251
13200994216,7cyclictest0-21swapper/109:40:251
13200994216,12cyclictest10056-21seq08:28:341
13200994216,12cyclictest10056-21seq08:28:341
13200994215,9cyclictest12527-21sed11:28:031
13200994215,9cyclictest12527-21sed11:28:031
13200994119,9cyclictest9692-21taskset09:56:171
13200994119,8cyclictest22818-21chrt10:31:241
13200994119,8cyclictest22818-21chrt10:31:241
13200994118,7cyclictest24048-21chrt07:42:361
13200994118,10cyclictest2825-21runrttasks12:30:351
13200994117,10cyclictest7904-21runrttasks09:52:351
13200994117,10cyclictest7904-21runrttasks09:52:351
13200994117,10cyclictest15746-21seq08:44:101
13200994117,10cyclictest15746-21seq08:44:101
13200994116,7cyclictest19598-21mailstats07:28:021
13200994116,7cyclictest19598-21mailstats07:28:021
13200994116,7cyclictest19598-21mailstats07:28:021
89142400,1sleep016-21ksoftirqd/008:27:540
89142400,1sleep016-21ksoftirqd/008:27:540
60172400,3chrt0-21swapper/208:18:032
60172400,3chrt0-21swapper/208:18:032
13200994020,6cyclictest24339-21date12:02:461
13200994020,6cyclictest24339-21date12:02:461
13200994019,12cyclictest6556-21runrttasks12:40:201
13200994019,12cyclictest6556-21runrttasks12:40:201
13200994018,9cyclictest18357-21taskset11:44:251
13200994018,9cyclictest18357-21taskset11:44:251
13200994018,9cyclictest18357-21taskset11:44:251
13200994018,9cyclictest13466-21seq10:06:351
13200994018,9cyclictest13466-21seq10:06:351
13200994018,9cyclictest13466-21seq10:06:351
13200994016,8cyclictest0-21swapper/107:53:401
13200994016,8cyclictest0-21swapper/107:53:401
13200994016,10cyclictest31545-21taskset12:21:061
13200994016,10cyclictest31545-21taskset12:21:061
13200994016,10cyclictest31545-21taskset12:21:061
13200994015,12cyclictest749-21runrttasks10:48:441
13200994015,12cyclictest749-21runrttasks10:48:441
13200994015,12cyclictest749-21runrttasks10:48:441
98672390,3sleep20-21swapper/208:28:042
98672390,3sleep20-21swapper/208:28:042
13200993930,7cyclictest0-21swapper/109:44:351
13200993930,7cyclictest0-21swapper/109:44:351
13200993918,8cyclictest28877-21taskset09:19:531
13200993918,8cyclictest28877-21taskset09:19:531
13200993917,8cyclictest26144-21/usr/sbin/munin10:38:041
13200993916,9cyclictest22239-21taskset11:56:301
13200993916,8cyclictest28913-21ntp_states12:13:001
13200993916,8cyclictest28913-21ntp_states12:13:001
13200993916,8cyclictest0-21swapper/109:08:451
13200993916,8cyclictest0-21swapper/109:08:451
13200993916,8cyclictest0-21swapper/109:08:451
13200993915,10cyclictest27626-21runrttasks07:50:291
13200993915,10cyclictest27626-21runrttasks07:50:291
13200993825,10cyclictest2714-21pluginstate11:03:011
13200993825,10cyclictest2714-21pluginstate11:03:011
13200993825,10cyclictest2714-21pluginstate11:03:011
13200993817,7cyclictest1020-21latency_hist08:07:421
13200993817,7cyclictest1020-21latency_hist08:07:421
13200993817,7cyclictest1020-21latency_hist08:07:421
13200993813,12cyclictest10840-21taskset11:24:171
13200993813,12cyclictest10840-21taskset11:24:171
13200993813,12cyclictest10840-21taskset11:24:171
13200993813,11cyclictest3324-21df12:32:511
13200993813,11cyclictest3324-21df12:32:511
13200993729,6cyclictest0-21swapper/109:04:341
13200993729,6cyclictest0-21swapper/109:04:341
13200993727,8cyclictest700-21192.168.115.40-manager10:10:061
13200993727,8cyclictest700-21192.168.115.40-manager10:10:061
13200993727,8cyclictest700-21192.168.115.40-manager10:10:061
13200993727,7cyclictest0-21swapper/108:10:341
13200993727,7cyclictest0-21swapper/108:10:341
13200993727,7cyclictest0-21swapper/108:10:341
13200993724,10cyclictest7728-21sendmail_mailst08:23:011
13200993724,10cyclictest7728-21sendmail_mailst08:23:011
13200993715,10cyclictest17255-21/usr/sbin/munin08:48:031
13200993715,10cyclictest17255-21/usr/sbin/munin08:48:031
13194993731,4cyclictest16865-21unixbench_multi10:13:020
13194993731,4cyclictest16865-21unixbench_multi10:13:020
13194993731,4cyclictest16865-21unixbench_multi10:13:020
292012360,2sleep20-21swapper/207:53:032
292012360,2sleep20-21swapper/207:53:032
13200993628,5cyclictest0-21swapper/109:24:351
13200993628,5cyclictest0-21swapper/109:24:351
13200993628,5cyclictest0-21swapper/109:24:351
13200993624,9cyclictest25796-21sshd12:04:051
13200993624,9cyclictest25796-21sshd12:04:051
13200993623,10cyclictest21301-21ntp_states07:33:001
13200993623,10cyclictest21301-21ntp_states07:33:001
13200993527,5cyclictest0-21swapper/109:30:351
13200993527,5cyclictest0-21swapper/109:30:351
13200993526,7cyclictest0-21swapper/108:41:031
13200993526,7cyclictest0-21swapper/108:41:031
13200993525,8cyclictest31319-21sshd08:00:061
13194993528,5cyclictest21617-21sendmail09:02:410
13200993421,10cyclictest3778-21/usr/sbin/munin08:12:571
13200993421,10cyclictest3778-21/usr/sbin/munin08:12:571
319022330,1sleep032054-21gltestperf08:02:540
319022330,1sleep032054-21gltestperf08:02:540
319022330,1sleep032054-21gltestperf08:02:540
234632330,3sleep20-21swapper/207:38:032
13194993227,3cyclictest2854-21idleruntime-cro08:12:400
13194993227,3cyclictest2854-21idleruntime-cro08:12:400
13194993227,3cyclictest2854-21idleruntime-cro08:12:400
13194993226,5cyclictest572-21cups-browsed09:03:010
13194993226,5cyclictest572-21cups-browsed09:03:010
13194993223,6cyclictest9394-21latency_hist11:22:470
120772320,2sleep012257-21sed10:02:540
120772320,2sleep012257-21sed10:02:540
120772320,2sleep012257-21sed10:02:540
13194993126,4cyclictest1-21systemd12:08:050
13194993126,4cyclictest1-21systemd12:08:050
13194993126,4cyclictest1-21systemd12:08:050
13194993125,4cyclictest18027-21kernelversion10:17:570
13194993125,4cyclictest18027-21kernelversion10:17:570
13194993124,5cyclictest19976-21latency10:22:560
13194993124,5cyclictest19976-21latency10:22:560
13194993122,6cyclictest23081-21latency_hist10:32:470
13194993122,6cyclictest23081-21latency_hist10:32:470
13194993024,4cyclictest13177-21cyclictest09:54:140
13194993023,5cyclictest25942-21head09:12:550
13194993023,5cyclictest14416-21unixbench_multi11:33:030
13194993023,5cyclictest14416-21unixbench_multi11:33:030
13194993023,5cyclictest14416-21unixbench_multi11:33:030
13194993019,8cyclictest5239-21cut08:17:540
13194993019,8cyclictest5239-21cut08:17:540
13194992922,5cyclictest3730-21sshd11:07:490
13194992922,5cyclictest3730-21sshd11:07:490
13194992922,5cyclictest3730-21sshd11:07:490
13194992921,6cyclictest13167-21netstat08:37:590
13194992921,6cyclictest13167-21netstat08:37:590
304842280,2sleep20-21swapper/212:17:542
234752280,3sleep20-21swapper/210:32:542
234752280,3sleep20-21swapper/210:32:542
13194992824,3cyclictest29094-21gltestperf10:47:540
13194992824,3cyclictest29094-21gltestperf10:47:540
13194992824,3cyclictest29094-21gltestperf10:47:540
13194992823,3cyclictest0-21swapper/010:38:030
13194992821,5cyclictest30994-21idleruntime10:52:550
13194992821,5cyclictest30994-21idleruntime10:52:550
13194992821,5cyclictest27704-21fschecks_time09:17:530
13194992819,7cyclictest11171-21latency_hist11:27:430
13194992819,7cyclictest11171-21latency_hist11:27:430
13194992819,7cyclictest11171-21latency_hist11:27:430
35982270,4sleep3431rcuc/309:38:043
35982270,4sleep3431rcuc/309:38:043
35982270,4sleep3431rcuc/309:38:043
273522270,3sleep20-21swapper/210:42:552
273522270,3sleep20-21swapper/210:42:552
234752270,3sleep30-21swapper/311:58:023
234752270,3sleep30-21swapper/311:58:023
13194992723,2cyclictest0-21swapper/012:28:020
13194992721,3cyclictest0-21swapper/010:58:030
13194992721,3cyclictest0-21swapper/010:58:030
13194992720,5cyclictest30188-21fschecks_time12:17:530
13194992720,5cyclictest30188-21fschecks_time12:17:530
13194992720,5cyclictest11704-21sendmail10:02:400
13194992720,5cyclictest11704-21sendmail10:02:400
13194992719,6cyclictest14678-21systemd-journal11:54:060
13194992619,5cyclictest18540-21latency_hist07:27:430
13194992619,5cyclictest18540-21latency_hist07:27:430
13194992618,6cyclictest24701-21sort09:08:030
13194992618,6cyclictest24701-21sort09:08:030
13194992618,6cyclictest24701-21sort09:08:030
13194992618,5cyclictest0-21swapper/008:13:020
13194992618,5cyclictest0-21swapper/008:13:020
13194992519,4cyclictest0-21swapper/010:12:510
13194992519,4cyclictest0-21swapper/010:12:510
13194992519,4cyclictest0-21swapper/010:12:510
13194992518,5cyclictest28874-21latency_hist10:47:530
13194992517,5cyclictest0-21swapper/009:27:550
13194992517,5cyclictest0-21swapper/009:27:550
13194992418,4cyclictest18979-21gltestperf07:27:540
13194992418,4cyclictest18979-21gltestperf07:27:540
13194992418,4cyclictest18979-21gltestperf07:27:540
13194992418,4cyclictest0-21swapper/010:42:520
13194992418,3cyclictest0-21swapper/011:37:550
13194992418,3cyclictest0-21swapper/011:37:550
13194992418,3cyclictest0-21swapper/008:02:400
13194992417,4cyclictest0-21swapper/007:43:020
13194992417,4cyclictest0-21swapper/007:43:020
13194992417,4cyclictest0-21swapper/007:43:020
13194992416,6cyclictest7354-21awk11:17:420
13194992416,6cyclictest7354-21awk11:17:420
13194992415,7cyclictest6355-21latency_hist09:47:530
13194992415,7cyclictest6355-21latency_hist09:47:530
13194992318,3cyclictest0-21swapper/009:37:580
13194992318,3cyclictest0-21swapper/009:37:580
13194992318,3cyclictest0-21swapper/009:37:580
13194992317,3cyclictest0-21swapper/010:32:530
13194992317,3cyclictest0-21swapper/010:32:530
13194992316,5cyclictest16444-21fschecks_time08:47:540
13194992316,5cyclictest16444-21fschecks_time08:47:540
13194992316,4cyclictest0-21swapper/012:38:040
13194992316,4cyclictest0-21swapper/012:38:040
13194992316,4cyclictest0-21swapper/011:57:510
13194992316,4cyclictest0-21swapper/011:57:510
13194992315,6cyclictest30984-21sort12:18:020
13194992315,6cyclictest30984-21sort12:18:020
13194992315,6cyclictest30984-21sort12:18:020
13194992313,8cyclictest5561-21latency_hist11:12:460
13194992313,8cyclictest5561-21latency_hist11:12:460
13194992313,8cyclictest19741-21cron08:57:400
13194992313,8cyclictest19741-21cron08:57:400
319232220,1sleep20-21swapper/209:27:582
319232220,1sleep20-21swapper/209:27:582
13194992218,2cyclictest0-21swapper/011:52:410
13194992216,4cyclictest0-21swapper/009:32:580
13194992216,4cyclictest0-21swapper/009:32:580
13194992215,5cyclictest3496-21gltestperf12:32:530
13194992215,5cyclictest3496-21gltestperf12:32:530
13194992215,5cyclictest24680-21cut12:02:510
13194992215,5cyclictest24680-21cut12:02:510
13194992116,3cyclictest0-21swapper/012:22:560
13194992116,3cyclictest0-21swapper/012:22:560
13208992015,3cyclictest248762sleep209:08:052
13208992015,3cyclictest248762sleep209:08:052
13208992015,3cyclictest248762sleep209:08:052
13194992015,4cyclictest14518-21fschecks_count08:42:530
13194992015,4cyclictest14518-21fschecks_count08:42:530
13194992014,4cyclictest0-21swapper/011:42:550
13194992014,4cyclictest0-21swapper/011:42:550
13194992014,4cyclictest0-21swapper/011:42:550
219422190,3chrt0-21swapper/310:27:573
219422190,3chrt0-21swapper/310:27:573
1320899191,13cyclictest27731-21taskset09:17:532
1320899191,13cyclictest27731-21taskset09:17:532
1320899191,13cyclictest0-21swapper/212:27:522
1320899191,13cyclictest0-21swapper/212:27:522
1321499181,12cyclictest11691-21chrt10:02:403
1321499181,12cyclictest11691-21chrt10:02:403
1321499181,11cyclictest12978-21taskset11:32:413
1321499181,11cyclictest12978-21taskset11:32:413
1321499171,12cyclictest27461-21chrt10:42:563
1321499171,12cyclictest27461-21chrt10:42:563
1321499171,12cyclictest25871-21chrt10:38:023
1321499171,12cyclictest14705-21chrt10:08:033
1321499171,12cyclictest14705-21chrt10:08:033
1321499171,12cyclictest14705-21chrt10:08:033
1321499171,11cyclictest7944-21chrt11:17:543
1321499171,11cyclictest4207-21taskset08:13:013
1321499171,11cyclictest4207-21taskset08:13:013
1321499171,11cyclictest0-21swapper/312:32:403
116092171,2sleep20-21swapper/211:27:542
116092171,2sleep20-21swapper/211:27:542
1321499163,9cyclictest0-21swapper/311:04:053
1321499163,9cyclictest0-21swapper/311:04:053
1321499163,9cyclictest0-21swapper/311:04:053
13214991611,3cyclictest157592sleep311:38:003
13214991611,3cyclictest157592sleep311:38:003
1321499161,11cyclictest5697-21taskset11:12:513
1321499161,11cyclictest5697-21taskset11:12:513
1321499161,11cyclictest0-21swapper/309:22:573
1321499161,11cyclictest0-21swapper/309:22:573
1321499161,11cyclictest0-21swapper/309:22:573
1321499161,10cyclictest0-21swapper/308:37:533
1321499161,10cyclictest0-21swapper/308:37:533
1321499161,10cyclictest0-21swapper/307:57:513
1320899163,9cyclictest0-21swapper/209:48:052
1320899163,9cyclictest0-21swapper/209:48:052
1320899163,9cyclictest0-21swapper/209:44:052
1320899163,9cyclictest0-21swapper/209:44:052
1320899163,9cyclictest0-21swapper/208:13:052
1320899163,9cyclictest0-21swapper/208:13:052
1320899163,9cyclictest0-21swapper/207:59:062
1320899161,12cyclictest28683-21chrt12:12:562
1320899161,11cyclictest7097-21taskset08:22:532
1320899161,11cyclictest7097-21taskset08:22:532
1320899161,11cyclictest16473-21chrt08:47:542
1320899161,11cyclictest16473-21chrt08:47:542
1320899161,11cyclictest0-21swapper/207:22:552
1320899161,11cyclictest0-21swapper/207:22:552
1320899161,10cyclictest32237-21chrt08:02:552
1320899161,10cyclictest32237-21chrt08:02:552
1320899161,10cyclictest32237-21chrt08:02:552
1321499153,9cyclictest0-21swapper/310:35:063
1321499153,9cyclictest0-21swapper/310:35:063
1321499151,9cyclictest8247-21chrt09:52:513
1321499151,9cyclictest5210-21taskset12:37:533
1321499151,9cyclictest5210-21taskset12:37:533
1321499151,9cyclictest28178-21chrt09:17:583
1321499151,9cyclictest28178-21chrt09:17:583
1321499151,9cyclictest24304-21chrt09:07:573
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional