You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-25 - 13:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Mon May 25, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
14518992019,1cyclictest65850irq/126-lan19:25:121
14518991818,0cyclictest743-21snmpd20:20:191
14518991818,0cyclictest65850irq/126-lan21:34:171
14518991817,1cyclictest65850irq/126-lan21:15:181
14518991817,1cyclictest65850irq/126-lan20:45:131
14518991717,0cyclictest9851-21cat20:15:151
14518991717,0cyclictest743-21snmpd21:00:181
14518991717,0cyclictest743-21snmpd20:56:531
14518991717,0cyclictest65850irq/126-lan22:40:411
14518991717,0cyclictest65850irq/126-lan21:05:021
14518991717,0cyclictest65850irq/126-lan20:30:211
14518991717,0cyclictest65850irq/126-lan19:45:241
14518991717,0cyclictest65850irq/126-lan19:30:201
14518991716,1cyclictest65850irq/126-lan22:55:151
14518991716,1cyclictest65850irq/126-lan22:05:131
14518991716,1cyclictest65850irq/126-lan21:40:161
14518991716,1cyclictest65850irq/126-lan21:40:161
14518991616,0cyclictest65850irq/126-lan23:34:361
14518991616,0cyclictest65850irq/126-lan22:50:131
14518991616,0cyclictest65850irq/126-lan22:35:201
14518991616,0cyclictest65850irq/126-lan21:35:151
14518991616,0cyclictest65850irq/126-lan21:35:151
14518991616,0cyclictest65850irq/126-lan20:25:181
14518991616,0cyclictest65850irq/126-lan19:13:261
14518991616,0cyclictest65850irq/126-lan00:17:101
14518991615,1cyclictest65850irq/126-lan23:45:171
14518991615,1cyclictest65850irq/126-lan23:35:131
14518991615,1cyclictest65850irq/126-lan22:17:261
14518991615,1cyclictest65850irq/126-lan22:15:011
14518991615,1cyclictest65850irq/126-lan22:00:111
14518991615,1cyclictest65850irq/126-lan00:25:151
14518991515,0cyclictest65850irq/126-lan23:20:131
14518991515,0cyclictest65850irq/126-lan23:10:201
14518991515,0cyclictest65850irq/126-lan22:25:181
14518991515,0cyclictest65850irq/126-lan20:40:141
14518991515,0cyclictest65850irq/126-lan19:15:171
14518991515,0cyclictest65850irq/126-lan00:05:201
14518991515,0cyclictest65850irq/126-lan00:01:061
14518991514,1cyclictest65850irq/126-lan22:45:141
14518991514,1cyclictest65850irq/126-lan19:40:131
14518991414,0cyclictest743-21snmpd19:24:231
14518991414,0cyclictest65850irq/126-lan23:17:381
14518991414,0cyclictest65850irq/126-lan22:32:541
14518991414,0cyclictest65850irq/126-lan21:59:481
14518991414,0cyclictest65850irq/126-lan21:20:111
14518991414,0cyclictest65850irq/126-lan20:40:001
14518991414,0cyclictest65850irq/126-lan19:55:591
14518991414,0cyclictest65850irq/126-lan00:30:141
14518991414,0cyclictest65850irq/126-lan00:20:191
14518991414,0cyclictest29263-21cat22:20:141
14518991413,1cyclictest65850irq/126-lan23:40:471
14518991413,1cyclictest65850irq/126-lan00:10:461
14518991313,0cyclictest65850irq/126-lan23:57:161
14518991313,0cyclictest65850irq/126-lan20:50:131
14518991313,0cyclictest65850irq/126-lan20:05:131
14518991313,0cyclictest65850irq/126-lan20:00:121
14518991313,0cyclictest65850irq/126-lan00:38:081
14518991312,1cyclictest65850irq/126-lan21:47:211
14518991212,0cyclictest65850irq/126-lan23:09:531
14518991212,0cyclictest65850irq/126-lan21:50:021
14518991211,1cyclictest65850irq/126-lan23:25:141
14518991211,1cyclictest65850irq/126-lan21:25:161
14518991111,0cyclictest65850irq/126-lan23:50:171
14518991111,0cyclictest65850irq/126-lan19:53:161
14518991111,0cyclictest65850irq/126-lan19:35:151
1451899109,1cyclictest65850irq/126-lan20:10:121
145279998,1cyclictest743-21snmpd22:54:463
145279998,1cyclictest743-21snmpd00:16:023
145279998,1cyclictest741-21lldpd19:34:013
145239998,1cyclictest743-21snmpd23:14:252
145239998,1cyclictest741-21lldpd20:01:122
145189999,0cyclictest65850irq/126-lan21:10:151
145189998,1cyclictest65850irq/126-lan23:00:131
145139998,1cyclictest743-21snmpd22:52:000
145139998,1cyclictest743-21snmpd20:31:350
145139998,1cyclictest743-21snmpd20:17:320
145139998,1cyclictest506-21systemd-resolve21:22:420
145279988,0cyclictest743-21snmpd22:14:523
145279988,0cyclictest743-21snmpd19:49:543
145279988,0cyclictest741-21lldpd23:12:003
145279988,0cyclictest741-21lldpd22:26:093
145279988,0cyclictest741-21lldpd21:14:343
145279988,0cyclictest741-21lldpd20:56:123
145279988,0cyclictest741-21lldpd20:49:593
145279988,0cyclictest741-21lldpd20:21:503
145279987,1cyclictest743-21snmpd20:54:323
145279987,1cyclictest506-21systemd-resolve00:14:273
145279987,1cyclictest1564-21fschecks_time19:55:143
145279986,2cyclictest743-21snmpd22:15:343
145279986,2cyclictest743-21snmpd21:53:293
145279986,2cyclictest743-21snmpd21:47:573
145279986,2cyclictest743-21snmpd21:31:523
145279986,2cyclictest743-21snmpd20:27:173
145279986,2cyclictest743-21snmpd19:19:353
145279986,2cyclictest743-21snmpd19:14:593
145279986,2cyclictest19956-21cat20:40:153
145239988,0cyclictest743-21snmpd23:36:142
145239988,0cyclictest743-21snmpd20:14:232
145239988,0cyclictest743-21snmpd00:26:412
145239988,0cyclictest741-21lldpd21:07:292
145239988,0cyclictest741-21lldpd20:39:182
145239987,1cyclictest743-21snmpd21:22:322
145239987,1cyclictest741-21lldpd22:03:242
145239986,2cyclictest743-21snmpd22:39:332
145239986,2cyclictest743-21snmpd22:07:052
145239986,2cyclictest743-21snmpd00:06:152
145139988,0cyclictest743-21snmpd23:37:110
145139987,1cyclictest743-21snmpd23:29:480
145139987,1cyclictest743-21snmpd23:17:200
145139987,1cyclictest743-21snmpd21:56:320
145139987,1cyclictest743-21snmpd21:30:430
145139987,1cyclictest743-21snmpd21:15:570
145139987,1cyclictest741-21lldpd22:59:110
145139987,1cyclictest741-21lldpd19:45:220
145139986,2cyclictest743-21snmpd22:36:500
145139986,2cyclictest743-21snmpd21:35:430
145139986,2cyclictest743-21snmpd21:35:420
145139986,2cyclictest743-21snmpd20:45:110
145139986,2cyclictest743-21snmpd19:25:420
145139985,2cyclictest30014-21latency_hist21:05:010
145279977,0cyclictest743-21snmpd22:44:303
145279977,0cyclictest743-21snmpd00:30:473
145279977,0cyclictest741-21lldpd23:37:013
145279977,0cyclictest741-21lldpd21:26:343
145279977,0cyclictest741-21lldpd20:16:423
145279977,0cyclictest522-21avahi-daemon23:31:223
145279977,0cyclictest16934-21needreboot00:25:133
145279976,1cyclictest743-21snmpd22:35:423
145279976,1cyclictest743-21snmpd22:23:063
145279976,1cyclictest743-21snmpd19:23:573
145279976,1cyclictest741-21lldpd19:41:313
145279975,2cyclictest743-21snmpd23:08:343
145279975,2cyclictest743-21snmpd23:04:093
145279975,2cyclictest743-21snmpd21:19:423
145279975,2cyclictest2507-21cat23:50:123
145279975,2cyclictest0-21swapper/323:30:003
145239977,0cyclictest743-21snmpd23:25:062
145239977,0cyclictest743-21snmpd21:18:272
145239977,0cyclictest743-21snmpd19:25:482
145239977,0cyclictest743-21snmpd00:03:132
145239977,0cyclictest741-21lldpd22:29:232
145239977,0cyclictest741-21lldpd20:06:582
145239977,0cyclictest14504-21cyclictest23:45:132
145239976,1cyclictest522-21avahi-daemon22:11:202
145239976,1cyclictest522-21avahi-daemon21:26:102
145239976,1cyclictest29826-21cut19:45:102
145239975,2cyclictest743-21snmpd22:59:102
145239975,2cyclictest743-21snmpd22:21:092
145239975,2cyclictest743-21snmpd21:56:292
145239975,2cyclictest743-21snmpd21:30:312
145239975,2cyclictest743-21snmpd00:20:312
145239975,2cyclictest743-21snmpd00:11:262
145239975,2cyclictest26414-21cat20:55:142
145139977,0cyclictest743-21snmpd22:30:410
145139977,0cyclictest743-21snmpd22:05:460
145139977,0cyclictest743-21snmpd20:05:180
145139977,0cyclictest743-21snmpd19:18:260
145139977,0cyclictest741-21lldpd22:48:500
145139977,0cyclictest741-21lldpd20:04:370
145139977,0cyclictest741-21lldpd19:50:320
145139977,0cyclictest741-21lldpd00:04:020
145139976,1cyclictest743-21snmpd23:50:480
145139976,1cyclictest743-21snmpd22:29:330
145139976,1cyclictest741-21lldpd23:46:120
145139976,1cyclictest741-21lldpd22:44:190
145139976,1cyclictest17273-21fschecks_time23:10:120
145139975,2cyclictest743-21snmpd20:42:310
145139975,2cyclictest743-21snmpd20:20:100
145279966,0cyclictest743-21snmpd22:07:293
145279966,0cyclictest743-21snmpd19:37:363
145279966,0cyclictest743-21snmpd00:05:063
145279966,0cyclictest741-21lldpd00:20:153
145279966,0cyclictest522-21avahi-daemon21:38:283
145279966,0cyclictest522-21avahi-daemon21:38:283
145279965,1cyclictest743-21snmpd23:40:543
145279965,1cyclictest15779-21gltestperf20:30:133
145279965,1cyclictest14504-21cyclictest22:00:003
145279965,1cyclictest1279-21ntp_offset22:30:163
145279963,3cyclictest3532-21diskstats20:00:113
145279962,4cyclictest1128-21cat19:55:003
145239966,0cyclictest743-21snmpd23:40:092
145239966,0cyclictest743-21snmpd23:00:002
145239966,0cyclictest743-21snmpd22:45:412
145239966,0cyclictest743-21snmpd21:02:452
145239966,0cyclictest741-21lldpd00:30:592
145239965,1cyclictest743-21snmpd22:33:352
145239965,1cyclictest743-21snmpd21:13:322
145239965,1cyclictest743-21snmpd19:10:532
145239965,1cyclictest522-21avahi-daemon22:42:282
145239965,1cyclictest522-21avahi-daemon21:37:102
145239965,1cyclictest522-21avahi-daemon21:37:102
145239965,1cyclictest16102-21needreboot20:30:152
145239964,2cyclictest743-21snmpd23:19:042
145239964,2cyclictest743-21snmpd20:40:142
145239964,2cyclictest743-21snmpd20:21:162
145239964,2cyclictest743-21snmpd19:35:172
145239963,2cyclictest244-20systemd-journal19:44:582
145139966,0cyclictest743-21snmpd21:25:230
145139966,0cyclictest741-21lldpd19:57:310
145139966,0cyclictest522-21avahi-daemon20:53:320
145139965,1cyclictest743-21snmpd21:05:320
145139965,1cyclictest743-21snmpd00:07:520
145139965,1cyclictest573-21in:imuxsock23:33:010
145139965,1cyclictest17052-21ntp_kernel_pll_21:50:170
145139964,2cyclictest743-21snmpd00:22:440
145139964,2cyclictest17826-21grep20:35:140
145139963,3cyclictest987-21ntp_states21:10:190
145139963,3cyclictest743-21snmpd19:36:380
145139962,4cyclictest557-21NetworkManager19:32:580
145139962,4cyclictest557-21NetworkManager00:35:140
145139962,3cyclictest7402-21grep20:10:120
145139962,3cyclictest27085-21fw_forwarded_lo22:15:120
145139962,3cyclictest22853-21sed23:20:200
145139962,3cyclictest21489-21ntpq22:00:150
145139962,3cyclictest13456-21apt-get20:25:110
145279955,0cyclictest506-21systemd-resolve21:58:133
145279954,1cyclictest11183-21fschecks_count22:55:123
145279953,2cyclictest743-21snmpd20:38:373
145279953,2cyclictest21416-21sed23:19:593
145279952,3cyclictest557-21NetworkManager20:14:203
145279952,2cyclictest575-21rs:main3
145279952,2cyclictest4365-21grep23:55:133
145279952,2cyclictest13187-21pmu-power21:40:173
145279952,2cyclictest13187-21pmu-power21:40:163
145279950,4cyclictest5046-21ntpq21:20:163
145279950,4cyclictest21532-21ntpq00:35:183
145239955,0cyclictest741-21lldpd20:15:302
145239955,0cyclictest522-21avahi-daemon20:54:242
145239954,1cyclictest743-21snmpd20:47:082
145239954,1cyclictest532-21irqbalance21:50:232
145239954,1cyclictest421ktimers/200:15:172
145239953,2cyclictest743-21snmpd22:54:282
145239953,2cyclictest557-21NetworkManager21:45:002
145239953,2cyclictest26401-21cat23:30:162
145239952,3cyclictest557-21NetworkManager23:24:482
145239952,2cyclictest575-21rs:main2
145239952,2cyclictest244-20systemd-journal19:21:362
145139955,0cyclictest522-21avahi-daemon22:21:390
145139955,0cyclictest522-21avahi-daemon22:13:320
145139953,2cyclictest19131-21ntpq00:30:180
145139953,2cyclictest16019-21cron21:50:000
145139952,3cyclictest13491-21sed21:40:200
145139952,3cyclictest13491-21sed21:40:200
145139952,2cyclictest28742-21ls19:40:200
145139952,2cyclictest10815-21grep00:10:140
145139951,3cyclictest15188-21df23:05:100
145139950,4cyclictest15517-21ntpq19:10:180
145279941,2cyclictest7798-21collect222:45:173
145279941,2cyclictest5518-21tr20:05:123
145279941,2cyclictest32544-21cut23:45:123
145279940,4cyclictest21991-21ntpq19:25:173
145279940,3cyclictest31193-21ntpq21:05:173
145279940,3cyclictest21810-21fw_conntrack23:20:123
145239943,1cyclictest11227-21kworker/2:2+events_freezable_pwr_efficient19:16:492
145239942,2cyclictest743-21snmpd23:05:242
145239942,2cyclictest4843-21ntpq23:55:162
145239941,3cyclictest24016-21sed19:30:132
145239941,3cyclictest2272-21pmu-power19:55:202
145239941,2cyclictest31826-21grep19:50:132
145239941,2cyclictest26925-21tr22:15:112
145239941,2cyclictest20599-21apt-key00:34:592
145239941,2cyclictest13953-21wc20:25:152
145239941,2cyclictest12591-21head21:40:132
145239941,2cyclictest12591-21head21:40:122
145139943,1cyclictest31239-21ntpq23:40:170
145139942,2cyclictest25984-21awk20:55:100
145139941,2cyclictest4401-21grep23:55:120
145139941,2cyclictest13362-21cut23:00:150
145139940,3cyclictest19342-21df19:20:110
145139940,3cyclictest17128-21ntpq00:25:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional