You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-25 - 05:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Wed Mar 25, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
10229992018,2cyclictest65850irq/126-lan23:25:201
10238991818,0cyclictest743-21snmpd21:45:483
10229991818,0cyclictest65850irq/126-lan22:50:191
10229991817,1cyclictest65850irq/126-lan23:35:211
10229991817,1cyclictest65850irq/126-lan23:24:591
10229991817,1cyclictest65850irq/126-lan22:45:171
10229991817,1cyclictest65850irq/126-lan21:25:111
10229991817,1cyclictest65850irq/126-lan21:15:171
10229991817,1cyclictest65850irq/126-lan20:45:121
10229991817,1cyclictest65850irq/126-lan19:25:181
10229991816,2cyclictest65850irq/126-lan20:10:161
10238991717,0cyclictest743-21snmpd23:56:403
10229991716,1cyclictest65850irq/126-lan23:15:111
10229991716,1cyclictest65850irq/126-lan21:40:161
10229991716,1cyclictest65850irq/126-lan20:06:271
10229991716,1cyclictest65850irq/126-lan00:00:131
10229991715,2cyclictest65850irq/126-lan19:55:131
10229991715,2cyclictest65850irq/126-lan19:45:121
10229991715,2cyclictest65850irq/126-lan00:25:141
10238991616,0cyclictest743-21snmpd23:46:343
10238991616,0cyclictest743-21snmpd23:33:393
10238991616,0cyclictest743-21snmpd00:06:433
10238991616,0cyclictest27406-21cat19:50:143
10238991616,0cyclictest2182-21cat22:45:133
10229991616,0cyclictest65850irq/126-lan23:30:161
10229991616,0cyclictest65850irq/126-lan19:35:131
10229991616,0cyclictest65850irq/126-lan00:35:141
10229991615,1cyclictest65850irq/126-lan22:25:171
10229991615,1cyclictest65850irq/126-lan22:20:161
10229991615,1cyclictest65850irq/126-lan22:05:131
10229991614,2cyclictest65850irq/126-lan23:50:171
10238991515,0cyclictest743-21snmpd23:44:253
10238991515,0cyclictest743-21snmpd22:30:483
10238991515,0cyclictest743-21snmpd22:10:583
10238991515,0cyclictest743-21snmpd21:13:473
10238991515,0cyclictest743-21snmpd20:56:163
10238991515,0cyclictest743-21snmpd20:51:213
10238991515,0cyclictest743-21snmpd20:11:093
10238991515,0cyclictest25395-21cat19:45:133
10229991515,0cyclictest65850irq/126-lan22:41:271
10229991515,0cyclictest65850irq/126-lan21:50:151
10229991515,0cyclictest65850irq/126-lan21:30:211
10229991515,0cyclictest65850irq/126-lan19:40:141
10229991514,1cyclictest65850irq/126-lan23:45:211
10229991514,1cyclictest65850irq/126-lan22:35:141
10229991514,1cyclictest65850irq/126-lan21:55:131
10229991514,1cyclictest65850irq/126-lan21:35:111
10229991514,1cyclictest65850irq/126-lan21:00:151
10229991514,1cyclictest65850irq/126-lan20:15:131
10229991513,2cyclictest65850irq/126-lan22:10:201
10229991513,2cyclictest65850irq/126-lan21:05:131
10229991513,2cyclictest65850irq/126-lan20:54:551
10229991513,2cyclictest65850irq/126-lan20:00:161
10229991513,2cyclictest65850irq/126-lan19:10:221
10224991515,0cyclictest743-21snmpd22:51:070
10224991515,0cyclictest3103-21cat20:10:170
10238991414,0cyclictest743-21snmpd22:36:093
10229991414,0cyclictest65850irq/126-lan23:40:271
10229991414,0cyclictest65850irq/126-lan20:25:161
10229991414,0cyclictest65850irq/126-lan19:30:271
10229991413,1cyclictest65850irq/126-lan23:55:211
10229991413,1cyclictest65850irq/126-lan21:45:131
10229991413,1cyclictest65850irq/126-lan21:24:271
10229991413,1cyclictest65850irq/126-lan00:15:221
10229991412,2cyclictest65850irq/126-lan00:10:141
10224991414,0cyclictest743-21snmpd23:02:140
10224991414,0cyclictest743-21snmpd21:47:510
10224991414,0cyclictest743-21snmpd21:29:310
10224991414,0cyclictest743-21snmpd21:07:390
10224991414,0cyclictest743-21snmpd20:41:300
10224991414,0cyclictest743-21snmpd20:07:380
10224991414,0cyclictest743-21snmpd20:01:310
10224991414,0cyclictest743-21snmpd19:43:400
10224991414,0cyclictest23313-21cat21:00:150
10229991313,0cyclictest65850irq/126-lan22:00:131
10229991313,0cyclictest65850irq/126-lan22:00:121
10229991313,0cyclictest65850irq/126-lan20:40:181
10229991312,1cyclictest65850irq/126-lan23:05:191
10229991312,1cyclictest65850irq/126-lan22:30:131
10229991312,1cyclictest65850irq/126-lan00:05:181
10229991311,2cyclictest65850irq/126-lan00:20:201
10224991313,0cyclictest743-21snmpd23:59:510
10224991313,0cyclictest743-21snmpd23:45:220
10224991313,0cyclictest743-21snmpd23:34:510
10224991313,0cyclictest743-21snmpd22:55:130
10224991313,0cyclictest743-21snmpd22:29:300
10224991313,0cyclictest743-21snmpd22:00:150
10224991313,0cyclictest743-21snmpd22:00:140
10224991313,0cyclictest743-21snmpd21:38:350
10224991313,0cyclictest743-21snmpd20:54:480
10224991313,0cyclictest743-21snmpd20:27:260
10224991313,0cyclictest743-21snmpd19:31:280
10224991313,0cyclictest743-21snmpd19:25:400
10224991313,0cyclictest743-21snmpd00:30:500
10224991313,0cyclictest743-21snmpd00:08:470
10224991313,0cyclictest28073-21cat22:30:150
10224991313,0cyclictest13179-21cat20:35:150
10224991312,1cyclictest743-21snmpd00:23:590
10229991212,0cyclictest65850irq/126-lan23:04:211
10229991211,1cyclictest65850irq/126-lan22:55:161
10229991211,1cyclictest65850irq/126-lan21:10:111
10229991211,1cyclictest65850irq/126-lan00:30:191
10224991212,0cyclictest743-21snmpd23:13:170
10224991212,0cyclictest743-21snmpd22:19:100
10224991212,0cyclictest743-21snmpd22:08:230
10224991212,0cyclictest743-21snmpd21:58:050
10224991212,0cyclictest743-21snmpd21:30:380
10224991212,0cyclictest743-21snmpd21:15:260
10224991212,0cyclictest743-21snmpd20:22:170
10224991212,0cyclictest743-21snmpd00:25:190
10224991212,0cyclictest743-21snmpd00:17:320
10224991212,0cyclictest743-21snmpd00:01:490
1022999119,2cyclictest65850irq/126-lan23:10:161
10229991111,0cyclictest65850irq/126-lan20:55:151
10229991111,0cyclictest65850irq/126-lan20:30:231
10229991110,1cyclictest65850irq/126-lan20:35:181
1022999108,2cyclictest65850irq/126-lan22:16:271
1022999107,3cyclictest743-21snmpd19:18:361
10229991010,0cyclictest65850irq/126-lan19:53:271
102389999,0cyclictest741-21lldpd19:25:153
102339998,1cyclictest743-21snmpd23:02:232
102339998,1cyclictest743-21snmpd22:52:402
102339998,1cyclictest743-21snmpd22:41:232
102339998,1cyclictest743-21snmpd19:59:502
102339998,1cyclictest741-21lldpd23:31:302
102249999,0cyclictest21113-21fwupd20:55:110
102249998,1cyclictest743-21snmpd23:39:270
102389988,0cyclictest743-21snmpd23:08:403
102389988,0cyclictest743-21snmpd21:06:453
102389988,0cyclictest743-21snmpd20:28:303
102389988,0cyclictest741-21lldpd19:35:093
102339988,0cyclictest743-21snmpd22:57:202
102339988,0cyclictest743-21snmpd22:22:032
102339988,0cyclictest743-21snmpd21:24:012
102339988,0cyclictest743-21snmpd19:41:202
102339988,0cyclictest741-21lldpd23:26:172
102339988,0cyclictest741-21lldpd23:20:302
102339988,0cyclictest741-21lldpd22:10:062
102339988,0cyclictest741-21lldpd21:44:172
102339987,1cyclictest743-21snmpd20:31:082
102339987,1cyclictest743-21snmpd20:05:072
102339987,1cyclictest743-21snmpd19:36:222
102339987,1cyclictest743-21snmpd19:25:492
102339987,1cyclictest545-21thermald20:55:122
102339986,2cyclictest743-21snmpd23:17:452
102339986,2cyclictest743-21snmpd22:49:292
102339986,2cyclictest743-21snmpd20:41:492
102339986,2cyclictest743-21snmpd20:37:182
102299986,2cyclictest717-21ntpd20:20:171
102249988,0cyclictest743-21snmpd19:16:150
102249988,0cyclictest741-21lldpd23:29:060
102249988,0cyclictest741-21lldpd21:20:530
102249988,0cyclictest741-21lldpd00:36:010
102249988,0cyclictest741-21lldpd00:13:090
102249987,1cyclictest743-21snmpd22:36:270
102249987,1cyclictest743-21snmpd22:23:570
102249987,1cyclictest743-21snmpd19:36:040
102249987,1cyclictest741-21lldpd22:14:260
102249987,1cyclictest26243-21unixbench_multi19:45:200
102249986,2cyclictest743-21snmpd23:06:580
102389977,0cyclictest743-21snmpd23:22:023
102389977,0cyclictest743-21snmpd23:15:173
102389977,0cyclictest741-21lldpd20:48:343
102389977,0cyclictest741-21lldpd00:00:203
102389976,1cyclictest743-21snmpd23:50:123
102389976,1cyclictest743-21snmpd00:12:053
102389975,2cyclictest743-21snmpd22:03:303
102389975,2cyclictest743-21snmpd22:03:293
102389975,2cyclictest743-21snmpd21:04:333
102389975,2cyclictest743-21snmpd19:41:563
102339977,0cyclictest743-21snmpd22:25:312
102339977,0cyclictest743-21snmpd21:45:332
102339977,0cyclictest743-21snmpd19:45:342
102339977,0cyclictest743-21snmpd00:02:192
102339977,0cyclictest741-21lldpd22:08:312
102339977,0cyclictest741-21lldpd00:39:412
102339976,1cyclictest743-21snmpd21:54:502
102339976,1cyclictest522-21avahi-daemon19:50:322
102339976,1cyclictest22410-21cpuspeed_turbos23:35:132
102339976,1cyclictest19718-21ntp_offset19:30:162
102339975,2cyclictest743-21snmpd23:54:272
102339975,2cyclictest743-21snmpd21:39:022
102339975,2cyclictest743-21snmpd21:29:282
102339975,2cyclictest743-21snmpd19:10:032
102339975,2cyclictest743-21snmpd00:32:362
102339974,3cyclictest743-21snmpd20:51:302
102299977,0cyclictest65850irq/126-lan19:20:001
102249977,0cyclictest743-21snmpd23:17:240
102249977,0cyclictest743-21snmpd20:34:450
102249977,0cyclictest741-21lldpd19:55:010
102249977,0cyclictest522-21avahi-daemon21:50:500
102249975,2cyclictest743-21snmpd19:20:030
102389966,0cyclictest743-21snmpd20:15:173
102389966,0cyclictest741-21lldpd20:30:203
102389966,0cyclictest2788-21latency_hist21:30:013
102389965,1cyclictest741-21lldpd00:29:423
102389964,2cyclictest743-21snmpd21:42:383
102389964,2cyclictest743-21snmpd21:33:263
102389964,2cyclictest717-21ntpd23:03:123
102389962,3cyclictest15931-21sed00:35:213
102339966,0cyclictest743-21snmpd23:42:192
102339966,0cyclictest743-21snmpd21:59:472
102339966,0cyclictest743-21snmpd20:20:022
102339966,0cyclictest741-21lldpd23:48:122
102339966,0cyclictest741-21lldpd00:20:492
102339966,0cyclictest522-21avahi-daemon19:17:382
102339965,1cyclictest743-21snmpd21:06:332
102339965,1cyclictest741-21lldpd00:11:292
102339965,1cyclictest28380-21ntp_kernel_err22:30:162
102339965,1cyclictest15814-21fschecks_time22:00:132
102339965,1cyclictest15814-21fschecks_time22:00:122
102339963,3cyclictest14889-21apt-get19:20:112
102339962,3cyclictest3160-21df_inode21:30:132
102339962,3cyclictest21875-21fw_forwarded_lo22:15:122
102339961,5cyclictest557-21NetworkManager21:17:312
102249966,0cyclictest741-21lldpd23:41:210
102249966,0cyclictest522-21avahi-daemon23:20:290
102249964,2cyclictest743-21snmpd20:19:360
102249963,2cyclictest28250-21vmstat21:10:210
102249962,3cyclictest17370-21sed20:45:150
102389955,0cyclictest743-21snmpd20:38:423
102389955,0cyclictest1-21systemd22:16:403
102389954,1cyclictest522-21avahi-daemon22:42:203
102389953,2cyclictest743-21snmpd21:23:253
102389953,2cyclictest717-21ntpd20:06:423
102389953,2cyclictest717-21ntpd19:57:093
102389953,2cyclictest13030-21cat00:30:133
102389952,3cyclictest743-21snmpd22:27:283
102389952,3cyclictest717-21ntpd00:22:453
102389952,2cyclictest7158-21grep00:15:173
102389952,2cyclictest557-21NetworkManager22:59:043
102389952,2cyclictest4574-21ntpq22:50:183
102389952,2cyclictest31898-21smartctl20:00:183
102389952,2cyclictest29711-21ntpq21:15:153
102389952,2cyclictest244-20systemd-journal20:40:123
102389952,2cyclictest19721-21ldconfig19:30:163
102389952,2cyclictest19712-21seq23:25:513
102389952,2cyclictest10597-21sort19:10:133
102389951,3cyclictest13063-21ld23:10:173
102389951,3cyclictest12718-21fw_forwarded_lo19:15:133
102389951,3cyclictest11631-21memory21:50:153
102339954,1cyclictest743-21snmpd23:08:012
102339954,1cyclictest743-21snmpd20:48:242
102339954,1cyclictest522-21avahi-daemon21:03:322
102339953,2cyclictest743-21snmpd20:28:512
102339952,3cyclictest27056-21diskstats21:10:122
102339952,2cyclictest32037-21awk20:00:212
102339952,2cyclictest3169-21cat20:10:182
102339952,2cyclictest12324-21ls23:10:122
102339951,3cyclictest3492-21ps00:05:182
102339950,4cyclictest11331-21ntpq00:25:172
102249952,2cyclictest7209-21df_inode21:40:120
102249952,2cyclictest29015-21tune2fs23:50:120
102249952,2cyclictest12268-21latency_hist19:15:010
102249951,2cyclictest28882-21wc19:55:000
102249950,4cyclictest32556-21ntpq22:40:170
102389942,2cyclictest7131-21cat20:20:143
102389940,3cyclictest18391-21ntp_states22:05:183
102389940,3cyclictest14679-21gpg-connect-age19:20:003
102389940,3cyclictest13573-21cat21:55:123
102389940,2cyclictest5308-21/usr/sbin/munin21:35:133
102339942,2cyclictest7414-21open_files00:15:202
102339940,4cyclictest31666-21ntpq23:55:172
102339940,3cyclictest4829-21diskstats20:15:102
102339940,3cyclictest29636-21/usr/sbin/munin22:35:142
102249940,2cyclictest16-21ksoftirqd/022:45:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional