You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-15 - 20:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack4slot1s.osadl.org (updated Mon Dec 15, 2025 13:37:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1338121250,3sleep20-21swapper/210:01:532
1338121250,3sleep20-21swapper/210:01:532
217921040,3sleep20-21swapper/208:02:012
217921040,3sleep20-21swapper/208:02:012
66292960,3sleep30-21swapper/308:16:503
265702900,3sleep30-21swapper/312:02:023
129002860,3sleep20-21swapper/208:31:562
129002860,3sleep20-21swapper/208:31:562
125402860,3chrt0-21swapper/309:57:043
242862820,3sleep30-21swapper/309:02:003
15392820,3sleep30-21swapper/308:01:543
15392820,3sleep30-21swapper/308:01:543
190852810,3sleep20-21swapper/210:16:532
190852810,3sleep20-21swapper/210:16:532
320952770,2sleep20-21swapper/210:51:542
261492750,2sleep20-21swapper/207:41:512
41302660,2chrt4131-21sed08:07:031
317752660,3sleep20-21swapper/209:22:012
226492610,3sleep10-21swapper/110:26:531
226492610,3sleep10-21swapper/110:26:531
247032560,3chrt0-21swapper/110:31:511
132592520,1sleep10-21swapper/111:26:581
132592520,1sleep10-21swapper/111:26:581
259242470,2sleep20-21swapper/209:06:582
259242470,2sleep20-21swapper/209:06:582
54302460,3sleep20-21swapper/211:06:532
273292450,2sleep30-21swapper/307:42:373
305402410,3sleep20-21swapper/207:52:002
305402410,3sleep20-21swapper/207:52:002
131782410,1sleep112195-21/usr/sbin/munin08:32:001
131782410,1sleep112195-21/usr/sbin/munin08:32:001
49842400,2sleep10-21swapper/111:06:371
14697993927,10cyclictest550-21cron07:45:030
133552390,2sleep10-21swapper/110:01:531
133552390,2sleep10-21swapper/110:01:531
95512380,3sleep10-21swapper/109:51:511
14698993731,5cyclictest9998-21cron08:25:031
14698993731,5cyclictest9998-21cron08:25:031
269672360,5sleep126229-21/usr/sbin/munin10:36:581
90382350,6sleep19041-21sed11:16:531
193052350,2sleep019425-21missed_timers10:16:560
193052350,2sleep019425-21missed_timers10:16:560
292772340,3sleep30-21swapper/310:42:023
292772340,3sleep30-21swapper/310:42:023
248162340,1sleep124879-21ntpq07:36:571
277622330,3sleep20-21swapper/212:06:552
277622330,3sleep20-21swapper/212:06:552
14698993224,6cyclictest21388-21netstat10:21:581
14698993224,6cyclictest21388-21netstat10:21:581
14697993226,4cyclictest21849-21unixbench_multi10:22:020
14697993226,4cyclictest21849-21unixbench_multi10:22:020
14697993224,5cyclictest545-21in:imuxsock11:30:030
14697993224,5cyclictest545-21in:imuxsock11:30:030
14697993223,7cyclictest8554-21latency_hist11:15:070
14697993223,7cyclictest30983-21fschecks_time09:21:520
14698993125,5cyclictest23840-21kernelversion09:01:541
14698993119,3cyclictest181rcu_preempt12:11:561
14698993119,3cyclictest181rcu_preempt12:11:561
14697993126,3cyclictest14696-21cyclictest11:50:030
14697993126,3cyclictest14696-21cyclictest11:50:030
14697993125,4cyclictest27737-21cron10:40:030
3582300,4sleep20-21swapper/209:26:522
32532300,10sleep0171ktimers/012:26:590
14698993024,4cyclictest17642-21latency_hist11:40:041
14698993023,5cyclictest19301-21kernelversion10:16:551
14698993023,5cyclictest19301-21kernelversion10:16:551
14697993025,3cyclictest0-21swapper/011:20:030
14697993023,5cyclictest7065-21timerandwakeup12:37:010
14697993023,5cyclictest7065-21timerandwakeup12:37:010
14697993023,5cyclictest28374-21fschecks_time10:41:530
14697993023,5cyclictest28374-21fschecks_time10:41:530
14697993021,6cyclictest29097-21cut09:16:520
14697993021,6cyclictest29097-21cut09:16:520
275972290,1sleep127654-21date07:45:051
150052290,3chrt0-21swapper/211:31:582
14698992924,2cyclictest0-21swapper/112:26:591
14698992923,3cyclictest0-21swapper/108:55:031
14698992917,4cyclictest181rcu_preempt09:46:431
14698992917,3cyclictest181rcu_preempt12:31:561
14697992922,5cyclictest1778-21kernelversion10:56:550
14697992922,5cyclictest1778-21kernelversion10:56:550
14700992815,9cyclictest11013-21chrt09:54:513
14698992823,4cyclictest14696-21cyclictest11:21:531
14698992823,3cyclictest0-21swapper/111:00:031
14698992823,3cyclictest0-21swapper/111:00:031
14698992821,5cyclictest6284-21latency_hist08:15:031
14698992821,4cyclictest28560-21latency_hist09:15:031
14698992821,4cyclictest28560-21latency_hist09:15:031
14698992820,6cyclictest15847-21ntp_offset10:06:591
14698992820,6cyclictest15847-21ntp_offset10:06:591
14698992816,3cyclictest181rcu_preempt12:15:581
14698992815,4cyclictest181rcu_preempt09:10:061
14698992815,4cyclictest181rcu_preempt09:10:061
14697992820,6cyclictest7457-21rt-features08:16:590
14697992819,7cyclictest550-21cron10:35:030
46722270,3sleep00-21swapper/009:36:590
14700992717,7cyclictest30480-21chrt12:13:153
14700992717,7cyclictest30480-21chrt12:13:153
14700992717,7cyclictest10574-21chrt11:21:463
14700992716,8cyclictest8434-21chrt08:21:003
14700992716,8cyclictest8434-21chrt08:21:003
14700992715,7cyclictest29649-21chrt07:50:573
14700992715,7cyclictest29649-21chrt07:50:573
14698992723,3cyclictest14696-21cyclictest09:16:591
14698992723,3cyclictest14696-21cyclictest09:16:591
14698992722,3cyclictest5474-21latency_hist09:40:031
14698992717,3cyclictest181rcu_preempt12:05:481
14698992717,3cyclictest181rcu_preempt12:05:481
14698992716,4cyclictest60-21kcompactd008:19:081
14698992716,3cyclictest181rcu_preempt07:32:521
14698992712,4cyclictest90-1pr/ttyS012:40:041
14698992712,4cyclictest90-1pr/ttyS012:40:041
14697992723,3cyclictest25657-21latency_hist07:40:030
14697992721,4cyclictest749-21runrttasks11:11:590
14697992721,4cyclictest32294-21kernelversion10:51:560
14697992721,4cyclictest17296-21gltestperf10:11:530
14697992720,5cyclictest14546-21kernelversion08:36:540
28212260,3sleep30-21swapper/312:26:543
178592260,3sleep30-21swapper/311:40:073
14700992616,7cyclictest8615-21chrt11:15:433
14700992616,7cyclictest18777-21chrt10:16:293
14700992616,7cyclictest18777-21chrt10:16:293
14700992615,8cyclictest7108-21chrt09:42:123
14700992615,8cyclictest7108-21chrt09:42:123
14700992615,8cyclictest21960-21chrt10:22:123
14700992615,8cyclictest21960-21chrt10:22:123
14700992615,8cyclictest12366-21chrt11:26:043
14700992615,8cyclictest12366-21chrt11:26:043
14700992615,8cyclictest12112-21chrt08:30:453
14700992615,8cyclictest12112-21chrt08:30:453
14700992615,7cyclictest4998-21chrt11:06:463
14700992615,7cyclictest27693-21chrt10:39:373
14700992615,7cyclictest23780-21chrt07:34:493
14700992615,6cyclictest15533-21chrt08:39:493
14698992621,4cyclictest17789-21processes10:11:591
14698992619,5cyclictest21746-21fschecks_time08:56:511
14698992619,5cyclictest21746-21fschecks_time08:56:511
14698992619,5cyclictest1060-21latency_hist10:55:051
14698992616,2cyclictest181rcu_preempt08:00:091
14698992616,2cyclictest181rcu_preempt08:00:091
14697992621,4cyclictest21471-21/usr/sbin/munin08:56:590
14697992621,4cyclictest21471-21/usr/sbin/munin08:56:590
14697992621,3cyclictest0-21swapper/009:30:030
14697992619,5cyclictest7440-21latency_hist09:45:050
14697992619,5cyclictest7440-21latency_hist09:45:050
14697992619,5cyclictest5003-21/usr/sbin/munin11:06:570
14697992618,6cyclictest7585-21sshd09:45:370
14700992516,6cyclictest4091-21chrt12:30:403
14700992516,6cyclictest2848-21chrt08:05:523
14700992516,6cyclictest20920-21chrt08:52:283
14700992516,6cyclictest15105-21chrt10:06:493
14700992516,6cyclictest15105-21chrt10:06:493
14700992515,8cyclictest6736-21chrt11:10:203
14700992515,8cyclictest6736-21chrt11:10:203
14700992515,7cyclictest5907-21chrt12:35:143
14700992515,7cyclictest5907-21chrt12:35:143
14700992515,7cyclictest28372-21chrt09:12:463
14700992515,7cyclictest28372-21chrt09:12:463
14700992515,7cyclictest26570-21chrt09:08:323
14700992515,7cyclictest26570-21chrt09:08:323
14700992515,7cyclictest24057-21chrt07:35:373
14700992515,6cyclictest28869-21chrt09:16:273
14700992515,6cyclictest28869-21chrt09:16:273
14700992515,6cyclictest19100-21chrt08:47:493
14700992515,6cyclictest18373-21chrt10:14:003
14700992514,6cyclictest32110-21chrt09:22:553
14698992521,3cyclictest28227-21gltestperf07:46:541
14698992521,3cyclictest28227-21gltestperf07:46:541
14698992520,3cyclictest0-21swapper/111:42:001
14698992520,3cyclictest0-21swapper/108:41:541
14698992520,3cyclictest0-21swapper/108:41:541
14698992520,2cyclictest0-21swapper/109:31:591
14698992520,2cyclictest0-21swapper/109:31:591
14698992517,2cyclictest181rcu_preempt09:57:011
14698992516,7cyclictest7448-21missed_timers11:11:561
14698992516,7cyclictest7448-21missed_timers11:11:561
14698992516,7cyclictest18507-21ntp_offset08:46:571
14698992514,4cyclictest181rcu_preempt11:03:011
14698992514,4cyclictest181rcu_preempt11:03:011
14698992511,3cyclictest90-1pr/ttyS008:27:011
1469899251,10cyclictest29-21ksoftirqd/110:42:141
1469899251,10cyclictest29-21ksoftirqd/110:42:141
14697992519,4cyclictest31689-21ntp_kernel_pll_12:16:580
14697992518,5cyclictest29435-21gltestperf12:11:530
14697992518,5cyclictest29435-21gltestperf12:11:530
14697992518,5cyclictest22375-21needreboot11:51:580
14697992518,5cyclictest22375-21needreboot11:51:580
14697992518,4cyclictest0-21swapper/010:46:530
14697992518,4cyclictest0-21swapper/010:46:530
14700992415,6cyclictest7608-21chrt09:45:543
14700992415,6cyclictest4445-21chrt11:02:243
14700992415,6cyclictest4445-21chrt11:02:243
14700992415,6cyclictest32556-21chrt09:25:563
14700992415,6cyclictest30854-21chrt12:15:213
14700992415,6cyclictest23446-21chrt11:55:313
14700992414,7cyclictest23042-21chrt11:53:013
14700992414,7cyclictest23042-21chrt11:53:013
14700992414,7cyclictest22922-21chrt08:59:273
14700992414,7cyclictest22922-21chrt08:59:273
14700992414,7cyclictest15563-21chrt11:32:153
14700992414,6cyclictest6114-21chrt08:13:043
14698992418,5cyclictest25963-21latency12:01:561
14698992416,3cyclictest181rcu_preempt11:56:311
14698992415,2cyclictest181rcu_preempt12:21:531
14698992415,2cyclictest181rcu_preempt12:21:531
14698992413,4cyclictest181rcu_preempt08:35:461
14697992419,3cyclictest0-21swapper/012:00:030
14697992419,3cyclictest0-21swapper/008:26:580
14697992419,3cyclictest0-21swapper/008:11:570
14697992419,3cyclictest0-21swapper/008:06:540
14697992418,5cyclictest16372-21cut11:36:530
14697992418,4cyclictest19278-21latency_hist08:50:030
14697992418,4cyclictest0-21swapper/012:07:010
14697992418,4cyclictest0-21swapper/012:07:010
14697992418,3cyclictest0-21swapper/011:01:550
14697992418,3cyclictest0-21swapper/011:01:550
14697992418,3cyclictest0-21swapper/009:35:030
14697992418,3cyclictest0-21swapper/009:35:030
14697992417,5cyclictest15926-21/usr/sbin/munin08:41:590
14697992417,5cyclictest15926-21/usr/sbin/munin08:41:590
14697992417,4cyclictest0-21swapper/008:03:550
14697992417,4cyclictest0-21swapper/008:03:550
14697992415,7cyclictest9200-21netstat08:21:570
14697992415,7cyclictest9200-21netstat08:21:570
6872230,2sleep00-21swapper/012:21:530
6872230,2sleep00-21swapper/012:21:530
58382230,3sleep20-21swapper/212:35:052
14700992314,6cyclictest597-21chrt07:59:453
14700992314,6cyclictest24280-21chrt10:30:323
14700992314,6cyclictest1191-21chrt10:55:493
14700992314,6cyclictest1191-21chrt10:55:493
14700992313,7cyclictest28632-21chrt12:08:173
14700992313,7cyclictest28632-21chrt12:08:173
14700992312,6cyclictest31332-21chrt10:48:333
14700992312,6cyclictest31332-21chrt10:48:333
14700992311,7cyclictest10325-21chrt08:26:353
1469899234,9cyclictest29-21ksoftirqd/109:20:291
14698992318,4cyclictest575-21thd09:25:561
14698992318,3cyclictest0-21swapper/111:52:001
14698992318,3cyclictest0-21swapper/111:52:001
14698992318,3cyclictest0-21swapper/107:56:521
14698992317,5cyclictest21089-21unixbench_singl11:47:031
14698992317,5cyclictest21089-21unixbench_singl11:47:031
14698992317,4cyclictest0-21swapper/107:51:531
14698992317,4cyclictest0-21swapper/107:51:531
14698992312,5cyclictest27611-21kworker/u10:0+rpciod10:50:041
14698992312,5cyclictest27611-21kworker/u10:0+rpciod10:50:041
14698992312,3cyclictest181rcu_preempt11:31:231
14697992319,2cyclictest0-21swapper/012:02:000
14697992318,4cyclictest1346-21avahi-daemon12:32:010
14697992318,3cyclictest547-21rs:main0
14697992318,3cyclictest547-21rs:main0
14697992317,4cyclictest0-21swapper/010:30:030
14697992317,4cyclictest0-21swapper/010:30:030
167902220,2sleep20-21swapper/211:36:562
14700992216,4cyclictest3910-21chrt09:36:133
14700992216,4cyclictest13203-21chrt10:01:143
14700992216,4cyclictest13203-21chrt10:01:143
14700992215,4cyclictest19842-21chrt11:46:423
14700992215,4cyclictest19842-21chrt11:46:423
14700992213,6cyclictest1990-21chrt09:30:183
14700992213,6cyclictest1990-21chrt09:30:183
14699992211,8cyclictest15829-21chrt08:40:372
14699992211,8cyclictest15829-21chrt08:40:372
14698992213,7cyclictest6109-21cut09:41:531
14698992213,7cyclictest6109-21cut09:41:531
14697992218,2cyclictest0-21swapper/009:06:570
14697992218,2cyclictest0-21swapper/009:06:570
14697992217,3cyclictest24944-21latency_hist09:05:040
14697992217,3cyclictest0-21swapper/009:58:280
14697992217,3cyclictest0-21swapper/009:11:520
14697992217,3cyclictest0-21swapper/009:11:520
14697992216,4cyclictest31703-21fschecks_count07:56:510
14697992216,4cyclictest0-21swapper/007:31:530
14697992215,4cyclictest0-21swapper/010:06:530
14697992215,4cyclictest0-21swapper/010:06:530
14700992116,3cyclictest27841-21chrt07:46:313
14700992116,3cyclictest27841-21chrt07:46:313
14700992115,4cyclictest22490-21chrt10:26:183
14700992115,4cyclictest22490-21chrt10:26:183
14700992115,3cyclictest32762-21chrt12:20:433
14700992115,3cyclictest32762-21chrt12:20:433
14700992115,3cyclictest317022sleep310:50:343
14700992114,4cyclictest179322sleep311:40:553
14699992111,8cyclictest2743-21chrt10:59:342
14699992111,8cyclictest2743-21chrt10:59:342
14699992110,8cyclictest3521-21chrt09:33:552
14699992110,8cyclictest3521-21chrt09:33:552
14699992110,8cyclictest24873-21chrt11:57:472
14697992117,2cyclictest0-21swapper/011:21:590
14697992117,2cyclictest0-21swapper/009:51:530
14697992116,3cyclictest0-21swapper/011:44:160
14697992116,3cyclictest0-21swapper/010:05:050
14697992116,3cyclictest0-21swapper/010:05:050
14697992115,4cyclictest0-21swapper/008:52:010
14697992112,7cyclictest29971-21fschecks_time07:51:540
14697992112,7cyclictest29971-21fschecks_time07:51:540
14700992010,6cyclictest15800-21chrt08:40:133
14700992010,6cyclictest15800-21chrt08:40:133
14699992011,7cyclictest19769-21chrt11:45:452
14699992011,7cyclictest19769-21chrt11:45:452
14699992010,8cyclictest29336-21chrt07:49:392
14699992010,8cyclictest29336-21chrt07:49:392
14699992010,7cyclictest3151-21chrt11:01:472
14699992010,7cyclictest3151-21chrt11:01:472
14699992010,7cyclictest26698-21chrt12:02:132
14697992014,4cyclictest0-21swapper/011:32:010
14697992014,3cyclictest0-21swapper/007:46:530
14697992014,3cyclictest0-21swapper/007:46:530
30612190,3sleep20-21swapper/212:26:572
1469999199,7cyclictest31442-21chrt10:49:572
1469999199,7cyclictest31442-21chrt10:49:572
1469999199,7cyclictest29033-21chrt12:10:412
1469999199,7cyclictest29033-21chrt12:10:412
1469999199,6cyclictest3940-21chrt09:36:362
1469999198,8cyclictest23234-21chrt09:00:272
1469999198,8cyclictest19494-21chrt08:50:092
14699991913,4cyclictest263392sleep210:36:522
14699991910,7cyclictest11670-21chrt08:27:462
14699991910,6cyclictest30848-21chrt12:15:152
14699991910,6cyclictest19145-21chrt08:48:252
14699991910,6cyclictest13890-21chrt11:29:372
14699991910,6cyclictest13890-21chrt11:29:372
14699991910,6cyclictest10568-21chrt11:21:412
93902180,3sleep20-21swapper/208:21:592
93902180,3sleep20-21swapper/208:21:592
1469999189,7cyclictest5998-21chrt12:36:262
1469999189,7cyclictest5998-21chrt12:36:262
1469999189,7cyclictest23774-21chrt07:34:442
1469999189,7cyclictest17931-21chrt11:40:542
1469999189,7cyclictest16851-21chrt10:10:292
1469999189,6cyclictest9487-21chrt09:51:162
1469999189,6cyclictest29379-21chrt10:42:132
1469999189,6cyclictest29379-21chrt10:42:132
1469999189,6cyclictest23118-21chrt11:54:012
1469999189,6cyclictest23118-21chrt11:54:012
1469999189,6cyclictest21398-21chrt08:55:522
1469999189,6cyclictest21398-21chrt08:55:522
1469999189,6cyclictest1754-21chrt12:22:112
1469999189,6cyclictest1754-21chrt12:22:112
1469999188,7cyclictest8958-21chrt09:47:142
1469999188,7cyclictest8659-21chrt11:16:182
14699991813,3cyclictest248812sleep207:36:572
14699991810,6cyclictest6569-21chrt08:16:132
1469999179,6cyclictest4205-21chrt08:07:162
1469999179,6cyclictest22086-21chrt10:23:482
1469999179,6cyclictest22086-21chrt10:23:482
1469999179,6cyclictest15322-21chrt08:37:072
1469999179,6cyclictest12714-21chrt09:57:552
1469999178,7cyclictest31540-21taskset07:56:312
14699991713,3cyclictest351rcuc/210:27:112
14699991713,3cyclictest351rcuc/210:27:112
14699991713,3cyclictest351rcuc/209:41:402
14699991713,3cyclictest351rcuc/209:41:402
1469999168,6cyclictest28354-21taskset09:12:332
1469999168,6cyclictest28354-21taskset09:12:332
1469999168,6cyclictest24306-21chrt10:30:522
1469999167,6cyclictest15698-21chrt10:06:562
1469999167,6cyclictest15698-21chrt10:06:562
14699991611,4cyclictest351rcuc/209:15:472
14699991611,4cyclictest351rcuc/209:15:472
14699991610,4cyclictest6730-21chrt11:10:152
14699991610,4cyclictest6730-21chrt11:10:152
1469999159,4cyclictest6093-21chrt08:12:472
plot09:55:358
setyrange[0.8:*]5
setylabel"Numberoflatencysamples"6
setxrange[0:400]4
setxlabel"Latencyus-Maximumusplottedon2
settitle"Latencyrack4slot1s"0
setterminalpbmcolor1
setoutput"r4s1s.ppm"7
setlogscaley3
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional