You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-10 - 23:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Fri Apr 10, 2026 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1288992018,2cyclictest65850irq/126-lan12:25:143
1288992018,2cyclictest65850irq/126-lan08:56:523
1288991918,1cyclictest65850irq/126-lan11:22:383
1288991917,2cyclictest65850irq/126-lan09:25:123
1288991916,3cyclictest65850irq/126-lan07:25:173
1288991818,0cyclictest65850irq/126-lan09:15:193
1288991817,1cyclictest65850irq/126-lan11:05:273
1288991817,1cyclictest65850irq/126-lan10:05:113
1288991817,1cyclictest65850irq/126-lan09:57:563
1288991717,0cyclictest65850irq/126-lan12:17:533
1288991717,0cyclictest65850irq/126-lan10:25:163
1288991716,1cyclictest65850irq/126-lan12:00:113
1288991716,1cyclictest65850irq/126-lan11:13:013
1288991716,1cyclictest65850irq/126-lan09:10:193
1288991716,1cyclictest65850irq/126-lan09:05:123
1288991715,2cyclictest65850irq/126-lan10:18:293
1288991715,2cyclictest65850irq/126-lan07:24:363
1288991714,3cyclictest65850irq/126-lan12:35:153
1288991714,3cyclictest65850irq/126-lan11:00:183
1288991714,1cyclictest65850irq/126-lan08:35:113
1285991717,0cyclictest743-21snmpd12:31:582
1285991717,0cyclictest743-21snmpd11:24:182
1285991717,0cyclictest743-21snmpd10:18:312
1285991717,0cyclictest743-21snmpd08:56:402
1285991717,0cyclictest743-21snmpd08:53:162
1285991717,0cyclictest743-21snmpd08:39:092
1285991717,0cyclictest743-21snmpd08:14:592
1285991717,0cyclictest743-21snmpd07:39:042
1285991717,0cyclictest743-21snmpd07:31:242
1285991717,0cyclictest743-21snmpd07:29:032
1285991717,0cyclictest20544-21cat07:55:132
1285991717,0cyclictest11891-21cat11:30:132
1285991716,1cyclictest743-21snmpd09:17:462
1288991616,0cyclictest65850irq/126-lan12:10:103
1288991616,0cyclictest65850irq/126-lan12:05:153
1288991616,0cyclictest65850irq/126-lan08:45:123
1288991616,0cyclictest65850irq/126-lan07:10:143
1288991615,1cyclictest65850irq/126-lan11:15:123
1288991615,1cyclictest65850irq/126-lan10:20:143
1288991615,1cyclictest65850irq/126-lan07:30:133
1288991614,2cyclictest65850irq/126-lan11:35:153
1288991614,2cyclictest65850irq/126-lan11:30:163
1288991614,2cyclictest65850irq/126-lan10:30:103
1288991614,2cyclictest65850irq/126-lan07:40:113
1288991614,0cyclictest65850irq/126-lan08:05:203
1288991613,3cyclictest65850irq/126-lan09:00:103
1288991613,1cyclictest65850irq/126-lan10:00:123
1288991613,1cyclictest65850irq/126-lan08:25:163
1288991515,0cyclictest65850irq/126-lan12:23:293
1288991515,0cyclictest65850irq/126-lan11:25:213
1288991515,0cyclictest65850irq/126-lan09:45:103
1288991515,0cyclictest65850irq/126-lan09:30:193
1288991515,0cyclictest65850irq/126-lan08:53:133
1288991514,1cyclictest65850irq/126-lan12:30:113
1288991514,1cyclictest65850irq/126-lan11:44:593
1288991514,1cyclictest65850irq/126-lan08:20:143
1288991514,1cyclictest65850irq/126-lan08:10:173
1288991513,1cyclictest65850irq/126-lan08:15:123
1288991513,0cyclictest65850irq/126-lan10:50:153
1288991513,0cyclictest65850irq/126-lan10:35:133
1285991515,0cyclictest743-21snmpd09:29:022
1288991414,0cyclictest65850irq/126-lan11:50:203
1288991414,0cyclictest65850irq/126-lan11:45:183
1288991413,1cyclictest65850irq/126-lan11:55:173
1288991413,1cyclictest65850irq/126-lan07:15:123
1288991313,0cyclictest65850irq/126-lan07:59:133
1288991313,0cyclictest65850irq/126-lan07:54:433
1288991312,1cyclictest65850irq/126-lan09:35:153
1288991312,1cyclictest65850irq/126-lan07:45:143
1288991212,0cyclictest65850irq/126-lan10:55:143
1288991212,0cyclictest65850irq/126-lan09:52:123
1288991212,0cyclictest65850irq/126-lan09:40:103
1288991211,1cyclictest65850irq/126-lan10:40:123
1288991211,1cyclictest65850irq/126-lan09:20:153
1288991211,1cyclictest65850irq/126-lan08:30:193
1288991211,1cyclictest65850irq/126-lan07:59:593
1288991110,1cyclictest65850irq/126-lan10:10:173
128899109,1cyclictest65850irq/126-lan07:39:143
1288991010,0cyclictest65850irq/126-lan10:45:173
12889999,0cyclictest65850irq/126-lan08:40:133
12859998,1cyclictest743-21snmpd07:12:052
12859998,1cyclictest741-21lldpd09:06:292
12819998,1cyclictest743-21snmpd10:10:511
12819998,1cyclictest743-21snmpd09:43:441
12819998,1cyclictest743-21snmpd07:28:451
12819998,1cyclictest741-21lldpd07:15:511
12769998,1cyclictest743-21snmpd08:57:250
12769998,1cyclictest741-21lldpd10:05:200
12859988,0cyclictest743-21snmpd12:08:132
12859988,0cyclictest743-21snmpd11:48:342
12859988,0cyclictest743-21snmpd07:46:482
12859988,0cyclictest741-21lldpd11:37:002
12859988,0cyclictest741-21lldpd10:26:092
12859988,0cyclictest741-21lldpd08:42:032
12859988,0cyclictest741-21lldpd08:17:082
12859987,1cyclictest31710-21gltestperf09:40:122
12859986,2cyclictest743-21snmpd10:51:522
12859986,2cyclictest717-21ntpd09:20:092
12819988,0cyclictest743-21snmpd12:29:021
12819988,0cyclictest743-21snmpd10:58:281
12819988,0cyclictest743-21snmpd09:05:001
12819988,0cyclictest741-21lldpd10:25:251
12819988,0cyclictest741-21lldpd07:35:221
12819987,1cyclictest9829-21cut11:25:141
12819987,1cyclictest743-21snmpd12:36:541
12819987,1cyclictest743-21snmpd11:21:571
12819987,1cyclictest743-21snmpd11:04:111
12819987,1cyclictest741-21lldpd11:45:441
12819987,1cyclictest741-21lldpd08:03:081
12819987,1cyclictest522-21avahi-daemon10:45:561
12819986,2cyclictest743-21snmpd11:53:251
12819986,2cyclictest743-21snmpd07:10:531
12819986,2cyclictest717-21ntpd08:15:141
12819986,2cyclictest717-21ntpd08:10:131
12769988,0cyclictest743-21snmpd12:30:220
12769988,0cyclictest743-21snmpd12:28:080
12769988,0cyclictest743-21snmpd12:12:560
12769988,0cyclictest743-21snmpd11:32:360
12769988,0cyclictest743-21snmpd09:53:500
12769988,0cyclictest741-21lldpd11:52:200
12769988,0cyclictest741-21lldpd11:02:350
12769988,0cyclictest741-21lldpd09:07:350
12769988,0cyclictest741-21lldpd08:10:330
12769987,1cyclictest743-21snmpd11:24:090
12769987,1cyclictest743-21snmpd10:34:460
12769987,1cyclictest743-21snmpd10:23:280
12769987,1cyclictest743-21snmpd09:49:240
12769987,1cyclictest743-21snmpd08:36:050
12769987,1cyclictest743-21snmpd08:16:400
12769987,1cyclictest743-21snmpd07:31:150
12769987,1cyclictest11698-21cut08:54:590
12769986,2cyclictest743-21snmpd10:58:490
12769986,2cyclictest743-21snmpd07:43:220
12769986,2cyclictest717-21ntpd12:39:570
12769986,2cyclictest717-21ntpd11:40:420
12769986,2cyclictest717-21ntpd11:35:300
12769986,2cyclictest717-21ntpd11:12:230
12769986,2cyclictest717-21ntpd10:16:170
12769986,2cyclictest717-21ntpd09:56:550
12769986,2cyclictest717-21ntpd09:13:320
12769985,3cyclictest743-21snmpd09:23:100
12859977,0cyclictest743-21snmpd11:18:212
12859977,0cyclictest743-21snmpd10:38:092
12859977,0cyclictest743-21snmpd10:31:252
12859977,0cyclictest743-21snmpd10:06:442
12859977,0cyclictest743-21snmpd09:32:472
12859977,0cyclictest743-21snmpd09:01:542
12859977,0cyclictest743-21snmpd07:23:042
12859977,0cyclictest741-21lldpd12:15:122
12859977,0cyclictest741-21lldpd10:58:072
12859977,0cyclictest741-21lldpd10:10:452
12859977,0cyclictest741-21lldpd08:32:502
12859977,0cyclictest741-21lldpd08:01:122
12859977,0cyclictest522-21avahi-daemon11:05:302
12859977,0cyclictest522-21avahi-daemon07:55:002
12859976,1cyclictest743-21snmpd09:36:072
12859976,1cyclictest506-21systemd-resolve10:00:572
12859975,2cyclictest743-21snmpd09:11:252
12859975,2cyclictest743-21snmpd08:09:232
12819977,0cyclictest743-21snmpd12:16:011
12819977,0cyclictest743-21snmpd10:03:421
12819977,0cyclictest741-21lldpd12:13:121
12819977,0cyclictest741-21lldpd11:15:131
12819977,0cyclictest741-21lldpd11:13:301
12819977,0cyclictest741-21lldpd10:20:361
12819977,0cyclictest741-21lldpd09:29:001
12819977,0cyclictest741-21lldpd09:22:191
12819977,0cyclictest741-21lldpd08:53:191
12819977,0cyclictest741-21lldpd08:31:281
12819977,0cyclictest741-21lldpd07:31:571
12819976,1cyclictest743-21snmpd12:21:051
12819976,1cyclictest743-21snmpd09:54:351
12819976,1cyclictest743-21snmpd09:37:551
12819976,1cyclictest743-21snmpd08:39:351
12819976,1cyclictest743-21snmpd07:43:371
12819976,1cyclictest741-21lldpd12:34:581
12819976,1cyclictest522-21avahi-daemon10:07:231
12819975,2cyclictest743-21snmpd12:01:131
12819975,2cyclictest717-21ntpd11:05:201
12819975,2cyclictest717-21ntpd08:45:211
12769977,0cyclictest743-21snmpd11:25:530
12769977,0cyclictest743-21snmpd08:25:240
12769977,0cyclictest741-21lldpd11:06:510
12769977,0cyclictest741-21lldpd10:00:300
12769977,0cyclictest741-21lldpd07:21:200
12769976,1cyclictest8001-21cpuspeed_turbos08:45:120
12769976,1cyclictest743-21snmpd10:40:180
12769976,1cyclictest743-21snmpd10:26:270
12769976,1cyclictest743-21snmpd07:53:590
12769976,1cyclictest717-21ntpd12:15:040
12769976,1cyclictest717-21ntpd09:33:420
12769976,1cyclictest2087-21needreboot07:10:140
12769976,1cyclictest1268-21cyclictest12:20:120
12769976,1cyclictest12170-21needreboot10:10:140
12769975,2cyclictest743-21snmpd10:36:580
12769975,2cyclictest26116-21cat10:45:140
12769975,2cyclictest24609-21cat08:05:140
12769975,2cyclictest21780-21latency_hist09:20:000
12769972,4cyclictest25859-21cat12:04:590
12859966,0cyclictest741-21lldpd12:37:572
12859966,0cyclictest741-21lldpd11:55:132
12859966,0cyclictest741-21lldpd10:44:052
12859966,0cyclictest741-21lldpd08:47:482
12859965,1cyclictest522-21avahi-daemon12:10:352
12859965,1cyclictest29797-21kworker/2:2+events_freezable_pwr_efficient11:10:182
12859964,2cyclictest743-21snmpd11:50:162
12859963,2cyclictest329-21missed_timers08:25:162
12859962,4cyclictest557-21NetworkManager07:40:002
12859961,5cyclictest557-21NetworkManager09:46:092
12819966,0cyclictest741-21lldpd11:35:121
12819966,0cyclictest741-21lldpd07:45:381
12819965,1cyclictest743-21snmpd10:30:191
12819965,1cyclictest743-21snmpd10:19:161
12819965,1cyclictest743-21snmpd08:07:531
12819965,1cyclictest244-20systemd-journal07:51:181
12819964,2cyclictest743-21snmpd11:32:211
12819964,2cyclictest743-21snmpd09:59:211
12819964,2cyclictest717-21ntpd10:40:011
12819964,2cyclictest717-21ntpd09:45:011
12819963,3cyclictest743-21snmpd08:40:211
12819963,2cyclictest244-20systemd-journal10:38:531
12769966,0cyclictest743-21snmpd07:27:450
12769966,0cyclictest743-21snmpd07:19:320
12769966,0cyclictest741-21lldpd10:53:430
12769966,0cyclictest741-21lldpd08:00:270
12769965,1cyclictest743-21snmpd11:46:370
12769965,1cyclictest12370-21gltestperf07:35:130
12769964,2cyclictest743-21snmpd12:05:400
12769964,2cyclictest743-21snmpd08:43:330
12769964,2cyclictest717-21ntpd09:40:460
12769963,3cyclictest16373-21perl07:45:110
12859955,0cyclictest743-21snmpd12:26:322
12859955,0cyclictest741-21lldpd10:47:212
12859955,0cyclictest741-21lldpd09:56:082
12859953,2cyclictest743-21snmpd12:23:322
12859953,2cyclictest743-21snmpd11:04:562
12859953,2cyclictest717-21ntpd08:20:452
12859952,3cyclictest557-21NetworkManager09:53:462
12859952,2cyclictest9620-21entropy11:25:132
12859952,2cyclictest16222-21needreboot10:20:142
12819954,1cyclictest741-21lldpd07:20:401
12819954,1cyclictest26799-21ntpq12:05:151
12819954,1cyclictest21750-21fschecks_count11:55:101
12819954,1cyclictest12253-21gltestperf08:55:141
12819953,2cyclictest743-21snmpd09:10:041
12819952,3cyclictest32526-21perl08:25:141
12819952,3cyclictest20356-21cut07:55:131
12819952,2cyclictest27811-21grep10:50:111
12769955,0cyclictest741-21lldpd09:03:000
12769955,0cyclictest573-21in:imuxsock07:55:320
12769954,1cyclictest743-21snmpd08:32:320
12769952,2cyclictest30952-21sed08:20:160
12769951,3cyclictest24871-21sed09:25:140
12769950,4cyclictest23292-21latency_hist12:00:000
12859943,1cyclictest15895-21hddtemp_smartct11:40:122
12859941,2cyclictest4713-21ldconfig07:15:162
12859941,2cyclictest25222-21cat12:00:172
12819943,1cyclictest717-21ntpd08:20:011
12819942,2cyclictest27031-21cat09:30:151
12819942,2cyclictest15796-21grep11:40:111
12819941,2cyclictest20671-21grep09:15:151
12819940,3cyclictest14153-21diskstats09:00:111
12769942,2cyclictest5828-21cat11:15:140
12769940,3cyclictest29119-21df_inode09:35:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional