You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-19 - 04:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Fri Jun 19, 2026 00:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
221922995447,5cyclictest306205-21kworker/u8:1+events_unbound00:02:362
221926995336,6cyclictest258700-21kworker/u8:1+events_unbound21:17:193
221913995238,11cyclictest121ktimers/022:05:120
221922994837,6cyclictest223535-21cron19:15:012
221922994640,4cyclictest239393-21kworker/u8:1+events_unbound20:22:102
221917994535,5cyclictest0-21swapper/123:42:331
221922994433,8cyclictest311ktimers/222:05:112
221917994428,13cyclictest231ktimers/120:05:131
221917994333,6cyclictest256104-21grep20:45:281
221926994231,7cyclictest0-21swapper/323:20:003
221926994229,10cyclictest391ktimers/320:20:103
221922994223,7cyclictest299448-21kworker/u8:3+events_unbound23:11:152
221913994232,8cyclictest335854-21sendmail00:40:000
221917994132,6cyclictest251805-21fschecks_count20:35:151
221917994132,6cyclictest251805-21fschecks_count20:35:151
221926993931,4cyclictest0-21swapper/322:12:243
221922993932,5cyclictest292405-21kworker/u8:0+events_unbound23:47:352
221922993931,6cyclictest311ktimers/221:45:122
221917993931,4cyclictest260176-21idleruntime-cro21:00:001
22191399399,11cyclictest266231-21grep21:15:250
22191399398,13cyclictest272490-21fschecks_count21:35:150
22191399397,13cyclictest312075-21if_eth023:30:170
221926993831,4cyclictest321996-21idleruntime-cro23:59:593
221926993830,5cyclictest264860-21unixbench_singl21:10:263
221922993812,4cyclictest131rcu_preempt20:50:132
221917993830,4cyclictest0-21swapper/100:35:151
221917993827,8cyclictest308143-21sendmail23:19:591
22191399386,18cyclictest0-21swapper/022:29:500
22191399386,18cyclictest0-21swapper/022:29:490
221913993830,5cyclictest0-21swapper/022:45:010
221926993727,6cyclictest0-21swapper/322:30:023
221926993727,6cyclictest0-21swapper/322:30:023
221926993727,6cyclictest0-21swapper/321:05:013
221922993729,4cyclictest0-21swapper/220:40:012
221922993729,4cyclictest0-21swapper/220:40:002
22191399374,14cyclictest0-21swapper/020:35:010
221913993725,9cyclictest244176-21grep20:10:250
221913993628,5cyclictest277231-21cut21:50:010
221913993625,8cyclictest329011-21apt00:19:590
221922993527,5cyclictest297440-21unixbench_multi22:45:242
221922993524,8cyclictest256659-21apt-config20:50:012
221917993522,9cyclictest329017-21sendmail00:19:591
221926993424,6cyclictest0-21swapper/322:45:253
221922993427,4cyclictest311550-21munin-plugin-st23:30:002
221922993427,4cyclictest311550-21munin-plugin-st23:30:002
221922993426,4cyclictest0-21swapper/219:55:242
221913993411,6cyclictest11-21ksoftirqd/023:52:340
221922993326,4cyclictest260170-21sendmail21:00:002
221922993325,5cyclictest321971-21cron23:59:592
221922993322,7cyclictest0-21swapper/223:34:592
221917993326,4cyclictest0-21swapper/121:55:191
221917993326,4cyclictest0-21swapper/121:55:191
221917993325,4cyclictest0-21swapper/122:40:011
221917993325,4cyclictest0-21swapper/119:10:241
221913993325,5cyclictest438-21cron23:45:000
221913993325,4cyclictest0-21swapper/000:10:010
221913993323,7cyclictest281913-21grep22:00:250
221913993311,3cyclictest300175-21irqstats22:55:190
221926993226,4cyclictest258700-21kworker/u8:1+events_unbound22:32:253
221926993224,4cyclictest0-21swapper/320:05:253
221926993224,4cyclictest0-21swapper/319:25:163
221926993224,4cyclictest0-21swapper/319:25:163
221926993224,4cyclictest0-21swapper/300:30:243
221926993221,6cyclictest0-21swapper/319:45:243
221922993224,4cyclictest262275-21fschecks_count21:05:172
221917993224,4cyclictest0-21swapper/120:35:011
221917993222,6cyclictest230513-21grep19:30:261
221913993224,4cyclictest0-21swapper/020:00:010
221913993220,9cyclictest292435-21cron22:31:000
221926993124,5cyclictest292405-21kworker/u8:0+events_unbound22:37:273
221926993123,4cyclictest0-21swapper/321:50:143
221926993123,4cyclictest0-21swapper/300:25:173
221926993123,4cyclictest0-21swapper/300:25:163
221926993121,6cyclictest0-21swapper/320:30:003
221926993120,7cyclictest0-21swapper/320:15:253
221922993125,3cyclictest232671-21kthreadd19:40:012
221922993117,5cyclictest292405-21kworker/u8:0+events_unbound00:17:572
221913993122,5cyclictest0-21swapper/020:49:590
221913993121,6cyclictest242197-21kworker/u8:2+events_unbound20:55:140
221913993117,10cyclictest121ktimers/020:25:120
221926993022,4cyclictest227572-21auditctl19:25:003
221926993022,4cyclictest0-21swapper/300:10:263
221922993023,3cyclictest0-21swapper/221:15:152
221922993015,5cyclictest131rcu_preempt22:22:032
221922993015,5cyclictest131rcu_preempt22:22:032
221922993010,11cyclictest0-21swapper/222:11:282
221917993023,4cyclictest0-21swapper/120:20:001
221917993022,4cyclictest0-21swapper/120:20:241
221917993021,5cyclictest241218-21munin-plugin-st20:05:001
22191399306,9cyclictest271199-21ntpq21:30:220
22191399302,9cyclictest244975-21fschecks_count20:15:140
221913993022,6cyclictest299444-21sshd22:53:110
221913993022,4cyclictest0-21swapper/020:05:250
221913993021,7cyclictest121ktimers/023:55:060
221913993016,11cyclictest332665-21apt-get00:30:100
221913993016,11cyclictest260412-21/usr/sbin/munin21:00:130
221913993011,4cyclictest222183-21df19:10:140
221926992922,5cyclictest292405-21kworker/u8:0+events_unbound22:57:293
221926992921,5cyclictest391ktimers/323:30:113
221926992919,6cyclictest327747-21tune2fs00:15:163
221922992922,4cyclictest0-21swapper/222:15:262
221922992922,4cyclictest0-21swapper/222:15:262
221922992922,3cyclictest0-21swapper/223:20:262
221922992921,5cyclictest0-21swapper/223:15:242
221922992920,5cyclictest208-21systemd-logind19:52:042
22191799298,7cyclictest131rcu_preempt21:30:131
221917992921,4cyclictest0-21swapper/122:45:151
221917992920,5cyclictest0-21swapper/123:12:291
22191399297,13cyclictest303561-21if_eth023:05:180
221913992918,7cyclictest288451-21/usr/sbin/munin22:20:250
221913992918,7cyclictest288451-21/usr/sbin/munin22:20:250
221926992821,3cyclictest0-21swapper/320:45:163
221926992820,4cyclictest0-21swapper/323:55:003
221926992820,4cyclictest0-21swapper/321:25:273
221926992819,5cyclictest0-21swapper/323:35:263
221926992817,7cyclictest0-21swapper/319:50:253
221922992822,4cyclictest258700-21kworker/u8:1+events_unbound21:28:142
221922992822,3cyclictest0-21swapper/220:05:012
221922992820,6cyclictest311ktimers/222:40:122
221922992819,7cyclictest293559-21ntp_kernel_pll_22:35:222
221922992819,6cyclictest0-21swapper/222:30:012
221922992819,6cyclictest0-21swapper/222:30:012
22192299281,8cyclictest0-21swapper/221:30:132
221922992817,5cyclictest251186-21kworker/u8:0+events_unbound21:04:502
22192299281,12cyclictest281923-21grep22:00:242
22192299280,7cyclictest301294-21cron23:00:012
221917992820,4cyclictest0-21swapper/122:20:011
221917992820,4cyclictest0-21swapper/122:20:011
221913992820,4cyclictest0-21swapper/021:12:160
221913992819,5cyclictest322447-21fschecks_time00:00:180
221913992815,10cyclictest267355-21diskstats21:20:150
221913992813,12cyclictest274579-21/usr/sbin/munin21:40:210
22192699272,4cyclictest131rcu_preempt23:25:103
22192699272,4cyclictest131rcu_preempt23:25:103
221926992721,4cyclictest306205-21kworker/u8:1+events_unbound23:12:293
221926992719,4cyclictest0-21swapper/322:00:253
221926992718,6cyclictest0-21swapper/321:55:253
221926992718,6cyclictest0-21swapper/321:55:253
221926992718,5cyclictest0-21swapper/320:50:253
221926992718,5cyclictest0-21swapper/319:30:273
221926992717,6cyclictest0-21swapper/323:40:273
22192299275,5cyclictest131rcu_preempt00:10:122
221922992721,4cyclictest327996-21kworker/u8:1+events_unbound00:30:112
221922992720,5cyclictest292405-21kworker/u8:0+events_unbound23:40:152
221922992720,4cyclictest314944-21sendmail23:40:002
22192299270,16cyclictest0-21swapper/221:35:122
221917992719,5cyclictest0-21swapper/120:40:251
221917992719,4cyclictest0-21swapper/119:40:261
221917992719,4cyclictest0-21swapper/119:17:001
221917992718,6cyclictest304261-21unixbench_multi23:05:271
221917992718,6cyclictest260972-21ntp_offset21:00:221
221917992717,7cyclictest327107-21basename00:15:001
22191399273,15cyclictest0-21swapper/023:29:280
22191399273,15cyclictest0-21swapper/023:29:280
221913992720,4cyclictest301670-21diskstats23:00:130
221913992719,3cyclictest0-21swapper/019:35:210
221913992717,7cyclictest304946-21sshd23:10:110
221913992717,7cyclictest297730-21cron22:48:010
221913992717,7cyclictest279159-21apt-get21:55:130
221913992717,7cyclictest279159-21apt-get21:55:130
221913992716,8cyclictest121ktimers/023:35:130
221913992715,9cyclictest317177-21/usr/sbin/munin23:45:170
221913992715,9cyclictest270061-21cron21:26:010
221926992620,3cyclictest0-21swapper/322:40:243
221926992619,4cyclictest288768-21head22:20:273
221926992619,4cyclictest288768-21head22:20:263
221926992619,3cyclictest0-21swapper/320:00:013
221926992617,5cyclictest0-21swapper/319:35:283
221926992616,6cyclictest0-21swapper/300:35:253
22192299269,11cyclictest301rcuc/200:25:252
22192299269,11cyclictest301rcuc/200:25:242
221922992620,4cyclictest230718-21kworker/u8:4+events_unbound19:33:412
221922992619,4cyclictest251440-21munin-plugin-st20:35:002
221922992619,4cyclictest0-21swapper/200:05:252
221922992619,3cyclictest0-21swapper/219:15:252
221922992617,7cyclictest3680039-21kworker/u8:3+events_unbound20:08:312
22192299261,13cyclictest0-21swapper/219:26:022
22192299261,13cyclictest0-21swapper/219:26:022
221917992621,3cyclictest298293-21fschecks_count22:50:151
221917992620,4cyclictest320552-21cpu23:55:141
221917992620,4cyclictest263815-21kworker/u8:3+events_unbound22:27:261
221917992620,4cyclictest263815-21kworker/u8:3+events_unbound22:27:261
221917992620,3cyclictest0-21swapper/121:10:001
221917992619,5cyclictest306205-21kworker/u8:1+events_unbound23:37:321
221917992619,4cyclictest285750-21munin-plugin-st22:14:591
221917992618,4cyclictest0-21swapper/100:05:161
221917992614,9cyclictest291663-21cut22:30:191
221913992620,3cyclictest13550irq/42-30be0000.ethernet22:40:000
221913992620,3cyclictest11-21ksoftirqd/019:50:020
221913992619,4cyclictest13550irq/42-30be0000.ethernet21:10:000
221913992618,5cyclictest308378-21apt-get23:20:140
221913992616,7cyclictest284714-21/usr/sbin/munin22:10:190
221913992616,7cyclictest257271-21/usr/sbin/munin20:50:180
221913992615,8cyclictest229501-21apt-get19:30:120
221913992614,9cyclictest254226-21/usr/sbin/munin20:40:230
221913992612,11cyclictest286376-21latency22:15:180
221913992612,11cyclictest286376-21latency22:15:180
221913992611,11cyclictest306875-21fschecks_time23:15:160
221913992610,12cyclictest233927-21unixbench_multi19:40:250
221913992610,12cyclictest228488-21/usr/sbin/munin19:25:230
221913992610,12cyclictest228488-21/usr/sbin/munin19:25:230
221926992517,4cyclictest0-21swapper/321:07:153
221926992516,6cyclictest0-21swapper/323:10:003
221926992515,7cyclictest271638-21grep21:30:283
221926992514,8cyclictest253123-21cron20:40:013
221926992514,8cyclictest253123-21cron20:40:013
221922992519,4cyclictest292405-21kworker/u8:0+events_unbound22:31:142
221922992519,3cyclictest0-21swapper/221:20:252
221922992518,4cyclictest243687-21ntpq20:10:212
221922992518,3cyclictest0-21swapper/223:50:252
221922992517,4cyclictest0-21swapper/221:40:252
221922992516,6cyclictest0-21swapper/219:20:232
221922992514,7cyclictest330316-21grep00:20:272
22192299250,9cyclictest0-21swapper/221:50:112
221917992518,5cyclictest299448-21kworker/u8:3+events_unbound23:02:291
221917992518,4cyclictest269153-21fschecks_time21:25:171
221917992517,4cyclictest0-21swapper/122:05:231
221917992515,6cyclictest0-21swapper/123:24:591
22191399258,8cyclictest131rcu_preempt20:21:010
22191399258,14cyclictest239975-21idleruntime20:00:140
221913992515,7cyclictest326083-21memory00:10:200
221913992515,7cyclictest252269-21/usr/sbin/munin20:35:230
221913992515,7cyclictest252269-21/usr/sbin/munin20:35:230
221913992514,8cyclictest331578-21/usr/sbin/munin00:25:240
221913992514,8cyclictest331578-21/usr/sbin/munin00:25:230
221913992512,10cyclictest226796-21/usr/sbin/munin19:20:220
221913992511,11cyclictest0-21swapper/021:50:100
221913992510,12cyclictest234783-21fschecks_count19:45:140
221926992417,4cyclictest391ktimers/323:49:183
221926992417,3cyclictest0-21swapper/300:05:173
221926992416,6cyclictest223530-21kworker/u8:0+events_unbound20:03:373
221926992416,4cyclictest301735-21fschecks_time23:00:143
221926992415,7cyclictest3680039-21kworker/u8:3+events_unbound19:42:043
221926992413,7cyclictest204-21dbus-daemon00:22:363
221926992413,7cyclictest0-21swapper/319:10:253
22192299245,4cyclictest131rcu_preempt20:15:112
221922992418,3cyclictest0-21swapper/221:10:172
221922992417,3cyclictest0-21swapper/221:55:192
221922992417,3cyclictest0-21swapper/221:55:182
221922992416,5cyclictest311ktimers/222:53:132
221922992413,4cyclictest131rcu_preempt23:04:252
221917992415,6cyclictest258048-21unixbench_singl20:50:271
221917992413,8cyclictest273828-21tr21:40:011
221913992414,7cyclictest329449-21/usr/sbin/munin00:20:160
221926992317,3cyclictest0-21swapper/323:20:233
221926992314,6cyclictest250062-21ls20:30:143
221926992314,6cyclictest0-21swapper/320:10:253
221926992313,6cyclictest0-21swapper/320:55:263
22192299238,10cyclictest311ktimers/220:25:112
221922992317,4cyclictest333852-21kworker/u8:0+events_unbound00:35:082
221922992317,4cyclictest251186-21kworker/u8:0+events_unbound20:41:592
221922992313,6cyclictest0-21swapper/219:40:212
221917992317,3cyclictest0-21swapper/121:15:271
221917992316,5cyclictest3680039-21kworker/u8:3+events_unbound19:37:021
221917992316,4cyclictest0-21swapper/123:55:011
221917992312,8cyclictest0-21swapper/100:25:251
221917992312,8cyclictest0-21swapper/100:25:251
221926992216,4cyclictest391ktimers/321:20:123
221926992216,3cyclictest0-21swapper/319:15:033
221926992214,6cyclictest263815-21kworker/u8:3+events_unbound21:40:483
221922992215,3cyclictest0-21swapper/219:45:212
221917992216,3cyclictest0-21swapper/121:40:171
221917992216,3cyclictest0-21swapper/120:25:211
221917992215,5cyclictest3680039-21kworker/u8:3+events_unbound20:12:071
221917992215,4cyclictest265280-21debian-sa121:15:011
221917992212,7cyclictest1-21systemd19:27:021
221917992212,7cyclictest1-21systemd19:27:011
221926992115,4cyclictest242197-21kworker/u8:2+events_unbound20:42:133
221926992112,6cyclictest0-21swapper/322:50:163
22192299211,11cyclictest0-21swapper/223:09:392
221917992115,4cyclictest275162-21kworker/u8:0+events_unbound21:52:231
221917992115,3cyclictest329993-21mailstats00:20:251
221917992115,3cyclictest0-21swapper/123:25:241
221917992115,3cyclictest0-21swapper/123:25:241
221917992114,4cyclictest0-21swapper/121:20:261
221917992114,3cyclictest0-21swapper/122:20:211
221917992114,3cyclictest0-21swapper/122:20:211
221917992114,3cyclictest0-21swapper/119:25:011
221917992112,6cyclictest0-21swapper/122:55:171
221926992014,3cyclictest0-21swapper/300:00:163
221917992014,3cyclictest0-21swapper/119:50:131
221917992013,4cyclictest231ktimers/100:32:191
221917992011,5cyclictest0-21swapper/123:47:341
22191799199,7cyclictest281545-21cut22:00:221
221917991911,5cyclictest231ktimers/100:03:391
22192699189,5cyclictest2863172chrt22:15:173
22192699189,5cyclictest2863172chrt22:15:173
221917991812,3cyclictest0-21swapper/119:55:181
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional