You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-29 - 06:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Sun Mar 29, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
14693993030,0cyclictest26203-21fwupd22:14:410
14693991918,1cyclictest65850irq/126-lan23:26:470
14693991918,1cyclictest65850irq/126-lan23:00:200
14693991818,0cyclictest65850irq/126-lan21:50:210
14693991817,1cyclictest65850irq/126-lan21:05:170
14693991817,1cyclictest65850irq/126-lan19:50:150
14693991817,1cyclictest65850irq/126-lan19:45:130
14693991817,1cyclictest65850irq/126-lan19:25:150
14693991717,0cyclictest65850irq/126-lan21:12:490
14693991717,0cyclictest65850irq/126-lan20:40:220
14693991717,0cyclictest65850irq/126-lan20:25:110
14693991716,1cyclictest65850irq/126-lan23:45:180
14693991716,1cyclictest65850irq/126-lan21:20:130
14693991716,1cyclictest65850irq/126-lan20:57:130
14693991716,1cyclictest65850irq/126-lan20:05:190
14693991616,0cyclictest65850irq/126-lan22:45:150
14693991616,0cyclictest65850irq/126-lan21:35:200
14693991616,0cyclictest65850irq/126-lan21:25:180
14693991616,0cyclictest65850irq/126-lan19:42:000
14693991616,0cyclictest65850irq/126-lan00:20:000
14693991616,0cyclictest65850irq/126-lan00:10:120
14693991616,0cyclictest65850irq/126-lan00:05:160
14693991616,0cyclictest65850irq/126-lan00:00:170
14693991615,1cyclictest65850irq/126-lan21:55:210
14693991615,1cyclictest65850irq/126-lan21:30:130
14693991615,1cyclictest65850irq/126-lan20:32:590
14693991615,1cyclictest65850irq/126-lan20:00:150
14693991615,1cyclictest65850irq/126-lan19:16:460
14693991515,0cyclictest65850irq/126-lan23:11:580
14693991515,0cyclictest65850irq/126-lan00:25:210
14693991514,1cyclictest65850irq/126-lan22:25:110
14693991514,1cyclictest65850irq/126-lan20:47:250
14693991514,1cyclictest65850irq/126-lan19:20:170
14693991514,1cyclictest65850irq/126-lan19:10:120
14693991514,1cyclictest65850irq/126-lan00:30:170
14693991414,0cyclictest65850irq/126-lan23:50:100
14693991414,0cyclictest65850irq/126-lan23:24:210
14693991414,0cyclictest65850irq/126-lan22:30:120
14693991414,0cyclictest65850irq/126-lan21:15:150
14693991414,0cyclictest65850irq/126-lan21:01:190
14693991413,1cyclictest65850irq/126-lan23:35:160
14693991413,1cyclictest65850irq/126-lan22:50:120
14693991413,1cyclictest65850irq/126-lan22:00:120
14693991413,1cyclictest65850irq/126-lan21:39:590
14693991313,0cyclictest65850irq/126-lan21:45:100
14693991313,0cyclictest65850irq/126-lan20:35:190
14693991313,0cyclictest65850irq/126-lan19:30:110
14693991312,1cyclictest65850irq/126-lan22:55:140
14693991312,1cyclictest65850irq/126-lan20:10:220
14693991312,1cyclictest65850irq/126-lan19:55:140
14693991212,0cyclictest65850irq/126-lan23:56:490
14693991212,0cyclictest65850irq/126-lan22:20:190
14693991212,0cyclictest65850irq/126-lan20:50:180
14693991212,0cyclictest65850irq/126-lan20:24:180
14693991211,1cyclictest65850irq/126-lan19:35:210
14693991211,1cyclictest65850irq/126-lan00:35:180
14693991111,0cyclictest65850irq/126-lan23:30:160
14693991110,1cyclictest65850irq/126-lan23:15:120
14693991110,1cyclictest65850irq/126-lan22:35:200
1470499102,6cyclictest17246-21ntpq23:10:162
1470499102,6cyclictest14413-21ntpq21:45:172
1470499102,5cyclictest25897-21chrt22:10:562
1470499101,6cyclictest23520-21chrt22:06:392
1469399109,1cyclictest65850irq/126-lan23:40:200
147089998,1cyclictest743-21snmpd20:02:263
147089998,1cyclictest741-21lldpd19:39:403
147049998,1cyclictest743-21snmpd21:25:262
147049998,1cyclictest743-21snmpd19:47:342
147049996,3cyclictest32250-21cat21:10:152
147049992,5cyclictest13498-21ntpq00:20:172
147049991,5cyclictest12798-21seq20:23:182
147049991,3cyclictest6634-21seq00:05:052
146999998,1cyclictest743-21snmpd20:29:431
146999998,1cyclictest743-21snmpd19:24:591
146939999,0cyclictest65850irq/126-lan23:05:140
146939999,0cyclictest65850irq/126-lan22:40:120
146939998,1cyclictest65850irq/126-lan22:05:140
147089988,0cyclictest743-21snmpd21:51:173
147089988,0cyclictest743-21snmpd21:38:533
147089988,0cyclictest741-21lldpd22:30:523
147089988,0cyclictest741-21lldpd21:56:403
147089988,0cyclictest741-21lldpd21:44:003
147089987,1cyclictest743-21snmpd23:14:483
147089987,1cyclictest743-21snmpd19:17:263
147089987,1cyclictest743-21snmpd00:34:443
147089987,1cyclictest741-21lldpd22:23:283
147089987,1cyclictest741-21lldpd20:09:403
147089986,2cyclictest743-21snmpd21:27:113
147089986,2cyclictest743-21snmpd20:41:523
147089986,2cyclictest743-21snmpd00:29:313
147089986,2cyclictest743-21snmpd00:22:313
147089986,2cyclictest7097-21cat00:05:143
147049987,1cyclictest743-21snmpd19:14:432
147049987,1cyclictest741-21lldpd22:55:022
147049986,2cyclictest743-21snmpd23:43:512
147049986,2cyclictest743-21snmpd22:44:492
147049986,2cyclictest743-21snmpd22:04:002
147049982,4cyclictest8212-21ntpq21:30:162
147049982,4cyclictest24466-21ntpq20:50:152
147049982,4cyclictest20355-21chrt19:21:002
147049982,4cyclictest15084-21ntpq23:05:162
147049982,2cyclictest21954-21taskset23:22:182
147049981,5cyclictest8840-21df_inode00:10:122
147049981,5cyclictest8432-21taskset22:50:122
147049981,5cyclictest7914-21ntpq20:10:182
147049981,5cyclictest29915-21users22:20:202
147049981,5cyclictest28204-21ntpq19:40:172
147049981,5cyclictest25225-21ntpq23:30:172
147049981,5cyclictest2193-21ntpq21:15:182
147049981,5cyclictest18775-21ntpq21:55:172
147049981,5cyclictest10915-21taskset21:35:562
147049981,5cyclictest0-21swapper/223:27:012
147049981,4cyclictest747-21runrttasks23:35:292
147049981,4cyclictest4696-21chrt20:02:582
147049981,4cyclictest2163-21taskset23:53:042
147049981,4cyclictest16869-21chrt19:15:072
147049981,4cyclictest16768-21apt-get00:30:112
147049981,4cyclictest12480-21diskstats23:00:132
147049981,3cyclictest32353-21grep22:29:592
147049981,3cyclictest1057-21taskset19:55:092
146999988,0cyclictest743-21snmpd20:23:211
146999988,0cyclictest743-21snmpd20:17:211
146999988,0cyclictest741-21lldpd23:19:451
146999988,0cyclictest741-21lldpd23:05:191
146999988,0cyclictest741-21lldpd20:45:191
146999987,1cyclictest741-21lldpd22:13:551
146999987,1cyclictest522-21avahi-daemon21:25:161
146999987,1cyclictest16188-21needreboot21:50:151
146999986,2cyclictest743-21snmpd23:49:581
146999986,2cyclictest743-21snmpd22:43:161
146999986,2cyclictest743-21snmpd22:36:281
146999986,2cyclictest743-21snmpd21:07:431
146999986,2cyclictest15186-21cat00:25:141
146999985,3cyclictest18113-21cat20:35:131
147089977,0cyclictest743-21snmpd23:48:523
147089977,0cyclictest743-21snmpd22:16:013
147089977,0cyclictest743-21snmpd20:57:023
147089977,0cyclictest741-21lldpd22:38:163
147089977,0cyclictest741-21lldpd22:29:203
147089977,0cyclictest741-21lldpd19:45:533
147089976,1cyclictest743-21snmpd23:37:123
147089976,1cyclictest743-21snmpd23:15:423
147089976,1cyclictest743-21snmpd20:32:573
147089976,1cyclictest743-21snmpd19:11:123
147089976,1cyclictest743-21snmpd00:16:043
147089975,2cyclictest743-21snmpd23:44:263
147089973,3cyclictest7699-21memory20:10:173
147049973,1cyclictest29946-21df21:05:112
147049972,3cyclictest5966-21ntpq20:05:172
147049972,3cyclictest4297-21ntp_states21:20:172
147049972,3cyclictest3448-21ntpq23:55:192
147049972,3cyclictest2958-21ntpq22:35:162
147049972,3cyclictest26491-21ntpq20:55:172
147049972,3cyclictest26184-21ntpq19:35:172
147049972,3cyclictest22100-21hddtemp_smartct20:45:142
147049972,3cyclictest19591-21ntpq00:35:192
147049972,3cyclictest19093-21ntp_192.168.11423:15:162
147049972,2cyclictest27628-21awk22:15:212
147049972,2cyclictest10514-21users20:15:212
147049972,2cyclictest0-21swapper/223:45:152
147049971,5cyclictest1676-21chrt22:31:492
147049971,5cyclictest16357-21taskset00:28:192
147049971,4cyclictest5510-21ntp_states00:00:182
147049971,4cyclictest31758-21fw_conntrack19:50:142
147049971,4cyclictest244-20systemd-journal00:19:482
147049971,4cyclictest22145-21ntpq19:25:172
147049971,4cyclictest14478-21ntpq20:25:172
147049971,4cyclictest13176-21chrt21:43:462
147049971,3cyclictest28509-21ntpq21:00:162
147049971,3cyclictest20462-21ld20:40:172
147049971,3cyclictest16337-21ntpq21:50:152
147049971,3cyclictest0-21swapper/220:35:162
147049971,3cyclictest0-21swapper/220:31:232
147049971,2cyclictest6652-21basename22:45:142
146999977,0cyclictest743-21snmpd22:05:521
146999977,0cyclictest743-21snmpd00:08:371
146999977,0cyclictest741-21lldpd23:01:211
146999977,0cyclictest741-21lldpd21:49:001
146999977,0cyclictest741-21lldpd00:17:371
146999976,1cyclictest4878-21idleruntime-cro20:04:591
146999976,1cyclictest29885-21cat19:45:131
146999975,2cyclictest743-21snmpd22:55:221
146999975,2cyclictest743-21snmpd00:35:201
146999975,2cyclictest26945-21cat22:15:141
146999975,2cyclictest1854-21cat21:15:151
146939976,1cyclictest743-21snmpd22:18:190
146939976,1cyclictest522-21avahi-daemon20:17:010
147089966,0cyclictest743-21snmpd22:49:203
147089966,0cyclictest743-21snmpd21:16:443
147089966,0cyclictest743-21snmpd00:12:013
147089966,0cyclictest741-21lldpd21:48:003
147089966,0cyclictest741-21lldpd21:21:303
147089966,0cyclictest741-21lldpd21:10:053
147089966,0cyclictest741-21lldpd19:34:053
147089966,0cyclictest522-21avahi-daemon22:58:153
147089965,1cyclictest743-21snmpd21:00:593
147089965,1cyclictest743-21snmpd00:37:143
147089965,1cyclictest573-21in:imuxsock23:34:023
147089965,1cyclictest29862-21cpuspeed_turbos21:05:113
147089964,2cyclictest743-21snmpd23:56:273
147089964,2cyclictest743-21snmpd22:01:063
147089964,2cyclictest743-21snmpd19:42:413
147089964,2cyclictest743-21snmpd19:26:223
147089964,2cyclictest743-21snmpd00:03:493
147089963,2cyclictest17969-21grep20:35:133
147049962,3cyclictest23562-21/usr/sbin/munin19:30:112
146999966,0cyclictest743-21snmpd23:34:181
146999966,0cyclictest743-21snmpd23:28:241
146999966,0cyclictest743-21snmpd21:55:301
146999966,0cyclictest743-21snmpd20:33:341
146999966,0cyclictest522-21avahi-daemon23:54:341
146999966,0cyclictest522-21avahi-daemon21:43:491
146999965,1cyclictest743-21snmpd22:30:071
146999965,1cyclictest741-21lldpd21:03:331
146999965,1cyclictest522-21avahi-daemon23:12:151
146999965,1cyclictest522-21avahi-daemon20:05:141
146999965,1cyclictest28632-21cpuspeed_turbos22:20:111
146999965,1cyclictest25476-21cpuspeed_turbos19:35:121
146999964,2cyclictest743-21snmpd19:50:271
146999964,2cyclictest743-21snmpd19:31:251
146999963,3cyclictest8093-21sed22:50:001
146999962,3cyclictest9794-21fw_conntrack21:35:121
146999962,3cyclictest8716-21sed21:30:201
146999962,3cyclictest26453-21ntpq20:55:171
146999960,6cyclictest5025-21cut00:00:131
146939966,0cyclictest65850irq/126-lan00:20:140
147089955,0cyclictest522-21avahi-daemon23:06:443
147089955,0cyclictest522-21avahi-daemon19:56:273
147089954,1cyclictest21247-21ntpq23:20:193
147089954,1cyclictest10012-21sh22:55:003
147089952,3cyclictest557-21NetworkManager23:27:433
147089952,3cyclictest557-21NetworkManager20:50:023
147089952,2cyclictest441-21sshd19:51:203
147089952,2cyclictest12205-21sendmail_mailst20:20:193
147089951,3cyclictest4694-21irqstats22:40:143
147089951,3cyclictest19268-21grep19:20:143
146999955,0cyclictest743-21snmpd23:22:331
146999954,1cyclictest8528-21fschecks_time22:50:131
146999954,1cyclictest743-21snmpd23:37:091
146999954,1cyclictest743-21snmpd20:13:121
146999954,1cyclictest506-21systemd-resolve00:20:151
146999954,1cyclictest15640-21ntpq19:10:161
146999953,2cyclictest743-21snmpd22:26:151
146999953,2cyclictest743-21snmpd19:44:501
146999953,2cyclictest743-21snmpd19:18:551
146999953,2cyclictest3607-21systemctl23:55:201
146999953,2cyclictest20224-21uniq22:00:131
146999952,3cyclictest557-21NetworkManager00:10:091
146999952,3cyclictest1088-21apt-get19:55:141
146999951,3cyclictest32612-21grep21:10:171
146999951,3cyclictest29283-21ntpq23:40:161
147089943,1cyclictest21963-21tune2fs20:45:133
147089942,2cyclictest25212-21sed22:10:163
147089941,3cyclictest557-21NetworkManager23:54:123
147089941,3cyclictest22065-21grep22:05:113
147089941,2cyclictest9314-21df20:15:123
147089941,2cyclictest717-21ntpd21:30:173
147089940,4cyclictest13064-21ntpq23:00:163
147089940,3cyclictest14346-21ntpq20:25:163
146999941,2cyclictest23705-21cat20:50:101
146999941,2cyclictest19995-21cat20:40:141
146999941,2cyclictest18133-21seq00:30:231
146999940,4cyclictest22213-21ntpq19:25:181
146999940,3cyclictest4260-21ntpq21:20:161
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional