You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-29 - 06:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Wed Jul 29, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16512993131,0cyclictest18728-21fwupd21:50:422
16500991918,1cyclictest65850irq/126-lan22:45:200
16500991818,0cyclictest65850irq/126-lan19:10:250
16500991817,1cyclictest65850irq/126-lan21:50:200
16500991817,1cyclictest65850irq/126-lan00:00:130
16500991717,0cyclictest65850irq/126-lan21:37:350
16500991717,0cyclictest65850irq/126-lan20:20:150
16500991717,0cyclictest65850irq/126-lan00:35:120
16500991716,1cyclictest65850irq/126-lan23:25:170
16500991716,1cyclictest65850irq/126-lan22:40:130
16500991716,1cyclictest65850irq/126-lan21:30:210
16500991716,1cyclictest65850irq/126-lan20:40:130
16500991716,1cyclictest65850irq/126-lan19:55:110
16500991616,0cyclictest65850irq/126-lan23:55:150
16500991616,0cyclictest65850irq/126-lan23:40:110
16500991616,0cyclictest65850irq/126-lan22:54:580
16500991616,0cyclictest65850irq/126-lan22:10:120
16500991616,0cyclictest65850irq/126-lan22:01:100
16500991616,0cyclictest65850irq/126-lan20:55:150
16500991616,0cyclictest65850irq/126-lan00:20:130
16500991615,1cyclictest65850irq/126-lan23:45:180
16500991615,1cyclictest65850irq/126-lan23:20:140
16500991615,1cyclictest65850irq/126-lan21:40:110
16500991615,1cyclictest65850irq/126-lan21:11:530
16500991615,1cyclictest65850irq/126-lan20:25:160
16500991615,1cyclictest65850irq/126-lan20:15:140
16500991615,1cyclictest65850irq/126-lan19:20:150
16500991615,1cyclictest65850irq/126-lan00:10:140
16500991515,0cyclictest65850irq/126-lan21:20:150
16500991515,0cyclictest65850irq/126-lan21:20:140
16500991515,0cyclictest65850irq/126-lan21:05:170
16500991515,0cyclictest65850irq/126-lan19:45:200
16500991515,0cyclictest65850irq/126-lan19:15:180
16500991515,0cyclictest65850irq/126-lan00:30:170
16500991514,1cyclictest65850irq/126-lan23:35:180
16500991514,1cyclictest65850irq/126-lan23:30:140
16500991514,1cyclictest65850irq/126-lan23:10:130
16500991514,1cyclictest65850irq/126-lan22:18:170
16500991514,1cyclictest65850irq/126-lan20:35:120
16500991514,1cyclictest65850irq/126-lan20:00:150
16500991414,0cyclictest65850irq/126-lan21:25:200
16500991414,0cyclictest65850irq/126-lan19:42:530
16500991413,1cyclictest65850irq/126-lan20:50:210
16500991413,1cyclictest65850irq/126-lan20:30:120
16500991413,1cyclictest65850irq/126-lan20:05:140
16500991413,1cyclictest65850irq/126-lan00:16:430
16500991313,0cyclictest65850irq/126-lan19:51:550
16500991312,1cyclictest65850irq/126-lan22:59:590
16500991312,1cyclictest65850irq/126-lan22:36:170
16500991312,1cyclictest65850irq/126-lan19:35:140
16500991312,1cyclictest65850irq/126-lan19:30:130
1650699128,4cyclictest743-21snmpd00:20:411
16500991212,0cyclictest65850irq/126-lan23:50:180
16500991212,0cyclictest65850irq/126-lan21:00:170
16500991211,1cyclictest65850irq/126-lan23:09:590
16500991211,1cyclictest65850irq/126-lan22:29:550
16500991211,1cyclictest65850irq/126-lan20:45:160
16500991211,1cyclictest65850irq/126-lan00:06:400
1650699116,5cyclictest743-21snmpd22:25:251
16500991111,0cyclictest65850irq/126-lan19:25:150
16500991111,0cyclictest65850irq/126-lan00:25:170
16500991110,1cyclictest65850irq/126-lan22:55:190
16500991110,1cyclictest65850irq/126-lan21:55:180
1650699106,1cyclictest743-21snmpd21:13:051
1650099109,1cyclictest65850irq/126-lan21:45:160
16500991010,0cyclictest65850irq/126-lan20:14:540
165179998,1cyclictest743-21snmpd20:00:333
165179998,1cyclictest743-21snmpd00:35:183
165179998,1cyclictest522-21avahi-daemon21:50:213
165129998,1cyclictest743-21snmpd21:18:362
165129998,1cyclictest743-21snmpd21:18:362
165129998,1cyclictest743-21snmpd20:21:162
165069998,1cyclictest743-21snmpd21:01:111
165069998,1cyclictest743-21snmpd19:47:361
165069998,1cyclictest743-21snmpd19:42:001
165069998,1cyclictest743-21snmpd19:16:531
165069997,2cyclictest743-21snmpd23:35:311
165069996,3cyclictest741-21lldpd19:52:161
165069996,3cyclictest717-21ntpd20:05:151
165069996,3cyclictest522-21avahi-daemon22:38:501
165069995,2cyclictest743-21snmpd21:36:011
165069995,2cyclictest743-21snmpd00:26:521
165069995,1cyclictest743-21snmpd23:21:571
165069995,1cyclictest743-21snmpd22:23:251
165069995,1cyclictest26933-21latency_hist19:35:001
165069994,2cyclictest743-21snmpd22:30:531
165179988,0cyclictest743-21snmpd22:55:083
165179988,0cyclictest743-21snmpd22:30:113
165179988,0cyclictest743-21snmpd19:46:333
165179988,0cyclictest741-21lldpd19:57:503
165179988,0cyclictest741-21lldpd19:38:253
165179987,1cyclictest743-21snmpd23:26:383
165179987,1cyclictest743-21snmpd00:21:443
165179987,1cyclictest741-21lldpd23:49:003
165179987,1cyclictest741-21lldpd00:01:403
165179986,2cyclictest743-21snmpd23:20:033
165179986,2cyclictest743-21snmpd22:44:383
165179986,2cyclictest743-21snmpd22:24:053
165129988,0cyclictest743-21snmpd21:20:242
165129988,0cyclictest743-21snmpd21:20:242
165129988,0cyclictest743-21snmpd20:47:052
165129988,0cyclictest741-21lldpd23:42:212
165129988,0cyclictest741-21lldpd23:01:172
165129988,0cyclictest741-21lldpd20:17:552
165129988,0cyclictest11777-21munin-plugin-st22:54:592
165129987,1cyclictest743-21snmpd23:19:422
165129987,1cyclictest743-21snmpd20:59:272
165129987,1cyclictest743-21snmpd00:20:442
165129987,1cyclictest743-21snmpd00:08:172
165129987,1cyclictest743-21snmpd00:00:002
165129987,1cyclictest3608-21cpuspeed_turbos22:35:102
165129987,1cyclictest24010-21fschecks_count22:05:132
165129986,2cyclictest743-21snmpd22:58:492
165129986,2cyclictest743-21snmpd19:16:562
165129986,2cyclictest743-21snmpd00:37:422
165069988,0cyclictest743-21snmpd23:34:341
165069988,0cyclictest743-21snmpd22:55:031
165069988,0cyclictest743-21snmpd20:31:131
165069988,0cyclictest743-21snmpd19:11:411
165069988,0cyclictest741-21lldpd20:45:351
165069988,0cyclictest741-21lldpd20:19:091
165069986,2cyclictest743-21snmpd00:34:371
165069986,0cyclictest522-21avahi-daemon21:52:101
165069985,0cyclictest743-21snmpd21:06:261
165009988,0cyclictest743-21snmpd22:05:250
165009987,1cyclictest65850irq/126-lan22:30:120
165009987,1cyclictest65850irq/126-lan22:20:000
165009986,2cyclictest743-21snmpd23:18:180
165179977,0cyclictest743-21snmpd21:39:453
165179977,0cyclictest743-21snmpd20:41:443
165179977,0cyclictest741-21lldpd21:16:043
165179977,0cyclictest741-21lldpd21:16:043
165179977,0cyclictest741-21lldpd20:52:113
165179977,0cyclictest741-21lldpd20:11:473
165179976,1cyclictest743-21snmpd23:32:073
165179976,1cyclictest743-21snmpd23:05:003
165179976,1cyclictest743-21snmpd22:47:323
165179976,1cyclictest743-21snmpd21:30:063
165179976,1cyclictest743-21snmpd00:31:213
165179976,1cyclictest741-21lldpd19:40:423
165179976,1cyclictest522-21avahi-daemon20:56:253
165179975,2cyclictest743-21snmpd19:30:473
165179975,2cyclictest743-21snmpd00:28:043
165179974,3cyclictest743-21snmpd20:47:473
165129977,0cyclictest743-21snmpd19:40:032
165129977,0cyclictest743-21snmpd19:25:202
165129977,0cyclictest741-21lldpd21:47:542
165129977,0cyclictest741-21lldpd21:10:212
165129976,1cyclictest743-21snmpd23:49:102
165129976,1cyclictest743-21snmpd19:24:262
165129976,1cyclictest741-21lldpd23:20:232
165129976,1cyclictest522-21avahi-daemon23:51:492
165129976,1cyclictest522-21avahi-daemon22:15:192
165129976,1cyclictest522-21avahi-daemon00:15:232
165129975,2cyclictest743-21snmpd20:54:172
165129975,2cyclictest743-21snmpd20:26:582
165129975,2cyclictest743-21snmpd20:01:242
165069977,0cyclictest743-21snmpd23:00:481
165069976,1cyclictest741-21lldpd20:38:391
165069976,1cyclictest506-21systemd-resolve21:58:571
165069975,2cyclictest743-21snmpd23:25:161
165069975,2cyclictest743-21snmpd23:17:511
165069975,2cyclictest743-21snmpd20:58:501
165069975,2cyclictest743-21snmpd20:41:271
165069975,2cyclictest743-21snmpd20:20:401
165069975,2cyclictest743-21snmpd19:22:561
165069975,2cyclictest717-21ntpd22:40:191
165069975,2cyclictest717-21ntpd22:15:191
165069975,2cyclictest717-21ntpd21:40:131
165069975,2cyclictest717-21ntpd00:15:141
165069975,0cyclictest741-21lldpd22:46:051
165069975,0cyclictest741-21lldpd21:27:441
165009976,1cyclictest65850irq/126-lan21:15:180
165009976,1cyclictest65850irq/126-lan21:15:170
165179966,0cyclictest743-21snmpd23:50:403
165179966,0cyclictest741-21lldpd23:41:393
165179966,0cyclictest741-21lldpd22:36:583
165179966,0cyclictest741-21lldpd20:33:093
165179966,0cyclictest522-21avahi-daemon00:10:563
165179966,0cyclictest20838-21gltestperf23:15:153
165179966,0cyclictest19196-21needreboot23:10:163
165179965,1cyclictest23433-21fschecks_time19:25:133
165179965,1cyclictest14561-21cpuspeed_turbos23:00:143
165179964,2cyclictest743-21snmpd20:22:403
165179964,2cyclictest7217-21grep20:05:133
165179964,2cyclictest31990-21cat21:05:143
165179963,3cyclictest5232-21apt-get21:20:133
165179963,3cyclictest5232-21apt-get21:20:123
165179963,2cyclictest575-21rs:main3
165179962,3cyclictest557-21NetworkManager19:20:023
165179962,3cyclictest29549-21apt-get21:00:103
165179962,3cyclictest12844-21irqstats00:15:163
165179961,4cyclictest244-20systemd-journal21:27:253
165129966,0cyclictest743-21snmpd22:00:372
165129966,0cyclictest743-21snmpd21:56:102
165129966,0cyclictest743-21snmpd19:35:332
165129966,0cyclictest743-21snmpd00:32:062
165129966,0cyclictest741-21lldpd22:30:492
165129966,0cyclictest741-21lldpd21:31:442
165129966,0cyclictest522-21avahi-daemon21:00:322
165129965,1cyclictest522-21avahi-daemon22:42:282
165129965,1cyclictest522-21avahi-daemon21:09:022
165129965,1cyclictest506-21systemd-resolve20:05:262
165129964,2cyclictest743-21snmpd20:38:492
165129962,3cyclictest15038-21cron21:45:002
165069966,0cyclictest741-21lldpd23:53:381
165069966,0cyclictest741-21lldpd23:49:561
165069966,0cyclictest741-21lldpd22:50:511
165069966,0cyclictest741-21lldpd19:36:061
165069966,0cyclictest741-21lldpd00:05:421
165069965,1cyclictest743-21snmpd23:57:001
165069965,1cyclictest743-21snmpd22:04:431
165069965,1cyclictest743-21snmpd21:30:121
165069965,1cyclictest743-21snmpd20:10:191
165069965,1cyclictest717-21ntpd20:50:161
165069965,1cyclictest522-21avahi-daemon00:38:451
165069964,2cyclictest717-21ntpd20:25:231
165069963,3cyclictest717-21ntpd19:55:131
165069963,2cyclictest743-21snmpd23:05:121
165069961,5cyclictest557-21NetworkManager23:44:241
165179955,0cyclictest741-21lldpd22:00:143
165179955,0cyclictest741-21lldpd21:46:203
165179954,1cyclictest743-21snmpd22:11:043
165179954,1cyclictest4909-21needreboot23:55:163
165179952,3cyclictest743-21snmpd20:39:133
165179952,3cyclictest557-21NetworkManager20:25:203
165179952,3cyclictest19853-21cut21:55:153
165179952,2cyclictest11238-21fw_packets20:15:153
165179950,4cyclictest17274-21diskstats19:10:163
165129955,0cyclictest741-21lldpd23:12:522
165129955,0cyclictest522-21avahi-daemon22:27:302
165129955,0cyclictest522-21avahi-daemon22:13:372
165129954,1cyclictest741-21lldpd19:48:462
165129953,2cyclictest17878-21cat20:30:142
165129953,2cyclictest0-21swapper/200:00:182
165129952,3cyclictest23238-21pluginstate20:45:012
165129952,2cyclictest8151-21cut21:25:182
165129952,2cyclictest3611-21ldconfig19:55:152
165129952,2cyclictest16895-21hddtemp_smartct23:05:162
165129951,3cyclictest26892-21fw_conntrack23:30:132
165129951,3cyclictest24770-21grep23:25:132
165129951,3cyclictest1712-21ntp_states19:50:182
165129950,4cyclictest25471-21fw_conntrack19:30:122
165129950,4cyclictest17032-21df_inode00:25:142
165069955,0cyclictest741-21lldpd21:20:171
165069955,0cyclictest741-21lldpd21:20:161
165069955,0cyclictest741-21lldpd00:12:051
165069955,0cyclictest506-21systemd-resolve23:13:251
165069954,1cyclictest4974-21cpuspeed_turbos20:00:101
165069953,2cyclictest717-21ntpd22:05:141
165069952,3cyclictest4399-21grep21:15:231
165069952,3cyclictest4399-21grep21:15:231
165069952,2cyclictest7149-21ntpq00:00:171
165069952,2cyclictest15323-21wc21:45:121
165069951,3cyclictest24521-21awk19:25:211
165179943,1cyclictest24029-21fschecks_count22:05:133
165179942,2cyclictest743-21snmpd21:12:363
165179942,2cyclictest32236-21head22:25:113
165179942,2cyclictest28646-21ntpq22:15:183
165179941,2cyclictest575-21rs:main3
165179941,2cyclictest1096-21fschecks_time19:50:153
165179940,4cyclictest557-21NetworkManager22:50:073
165179940,4cyclictest19863-21ntpq19:15:183
165179940,3cyclictest28776-21/usr/sbin/munin23:35:133
165129943,1cyclictest421ktimers/222:21:272
165129942,2cyclictest9565-21cut20:10:152
165129941,3cyclictest557-21NetworkManager22:45:002
165129941,3cyclictest29413-21ntpq23:35:172
165129941,2cyclictest11661-21sh21:35:142
165129940,4cyclictest11229-21ntpq00:10:172
165129940,3cyclictest17106-21/usr/sbin/munin19:10:152
165069941,2cyclictest26989-21sort22:10:201
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional