You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-26 - 00:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot6s.osadl.org (updated Wed Mar 25, 2026 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
31829994242,0cyclictest5239-21fwupd07:22:412
31824991918,1cyclictest65850irq/126-lan11:05:191
31824991918,1cyclictest65850irq/126-lan08:00:251
31824991817,1cyclictest65850irq/126-lan12:00:161
31824991817,1cyclictest65850irq/126-lan09:15:201
31824991817,1cyclictest65850irq/126-lan09:00:181
31824991817,1cyclictest65850irq/126-lan07:35:011
31824991717,0cyclictest65850irq/126-lan11:21:101
31824991717,0cyclictest65850irq/126-lan09:30:221
31824991717,0cyclictest65850irq/126-lan07:58:211
31824991717,0cyclictest65850irq/126-lan07:24:001
31824991716,1cyclictest65850irq/126-lan11:55:201
31824991716,1cyclictest65850irq/126-lan11:50:281
31824991716,1cyclictest65850irq/126-lan11:45:161
31824991716,1cyclictest65850irq/126-lan11:00:151
31824991716,1cyclictest65850irq/126-lan10:30:181
31824991716,1cyclictest65850irq/126-lan10:20:001
31824991716,1cyclictest65850irq/126-lan09:25:161
31824991616,0cyclictest65850irq/126-lan11:35:141
31824991616,0cyclictest65850irq/126-lan11:10:151
31824991616,0cyclictest65850irq/126-lan10:26:281
31824991616,0cyclictest65850irq/126-lan09:50:131
31824991616,0cyclictest65850irq/126-lan08:41:331
31824991616,0cyclictest65850irq/126-lan08:25:221
31824991615,1cyclictest65850irq/126-lan10:40:121
31824991615,1cyclictest65850irq/126-lan10:20:171
31824991615,1cyclictest65850irq/126-lan09:20:021
31824991615,1cyclictest65850irq/126-lan09:06:011
31824991615,1cyclictest65850irq/126-lan08:50:141
31824991615,1cyclictest65850irq/126-lan08:30:171
31824991515,0cyclictest65850irq/126-lan11:30:111
31824991515,0cyclictest65850irq/126-lan09:11:571
31824991515,0cyclictest65850irq/126-lan08:47:131
31824991515,0cyclictest65850irq/126-lan08:05:221
31824991514,1cyclictest65850irq/126-lan12:30:161
31824991514,1cyclictest65850irq/126-lan11:40:161
31824991514,1cyclictest65850irq/126-lan10:55:171
31824991514,1cyclictest65850irq/126-lan10:50:161
31824991514,1cyclictest65850irq/126-lan10:05:121
31824991514,1cyclictest65850irq/126-lan09:35:001
31824991513,1cyclictest65850irq/126-lan09:55:121
31824991414,0cyclictest65850irq/126-lan07:45:151
31824991414,0cyclictest65850irq/126-lan07:40:141
31824991413,1cyclictest65850irq/126-lan10:35:131
31824991413,1cyclictest65850irq/126-lan08:10:171
31824991313,0cyclictest65850irq/126-lan12:35:151
31824991313,0cyclictest65850irq/126-lan11:25:151
31824991312,1cyclictest65850irq/126-lan12:05:121
31824991312,1cyclictest65850irq/126-lan09:45:181
31824991312,1cyclictest65850irq/126-lan08:55:161
31824991312,1cyclictest65850irq/126-lan07:25:101
31824991212,0cyclictest65850irq/126-lan12:10:171
31824991212,0cyclictest65850irq/126-lan11:17:271
31824991212,0cyclictest65850irq/126-lan10:45:101
31824991212,0cyclictest65850irq/126-lan07:35:191
31824991211,1cyclictest65850irq/126-lan12:20:161
31824991211,1cyclictest65850irq/126-lan12:15:161
31824991211,1cyclictest65850irq/126-lan07:19:261
31824991111,0cyclictest65850irq/126-lan10:11:251
31824991110,1cyclictest65850irq/126-lan10:00:201
31824991110,1cyclictest65850irq/126-lan09:42:131
3182499109,1cyclictest65850irq/126-lan12:25:161
31824991010,0cyclictest65850irq/126-lan07:10:121
3182299106,4cyclictest0-21swapper/010:20:000
318369998,1cyclictest743-21snmpd12:01:003
318299999,0cyclictest741-21lldpd07:11:442
318299998,1cyclictest743-21snmpd07:57:122
318299998,1cyclictest743-21snmpd07:25:322
318299998,1cyclictest741-21lldpd10:43:272
318249998,1cyclictest741-21lldpd08:35:371
318229998,1cyclictest743-21snmpd12:37:020
318229998,1cyclictest743-21snmpd11:08:280
318229998,1cyclictest743-21snmpd09:33:040
318369988,0cyclictest743-21snmpd10:54:493
318369988,0cyclictest743-21snmpd07:52:363
318369988,0cyclictest741-21lldpd08:21:473
318369988,0cyclictest741-21lldpd07:47:163
318369987,1cyclictest743-21snmpd11:05:433
318369987,1cyclictest743-21snmpd09:56:073
318369987,1cyclictest741-21lldpd12:31:583
318369987,1cyclictest741-21lldpd12:29:173
318369986,2cyclictest743-21snmpd11:46:593
318369986,2cyclictest743-21snmpd11:11:113
318299988,0cyclictest743-21snmpd10:32:002
318299988,0cyclictest743-21snmpd08:08:192
318299988,0cyclictest743-21snmpd08:04:102
318299988,0cyclictest741-21lldpd11:45:402
318299988,0cyclictest741-21lldpd11:02:462
318299987,1cyclictest743-21snmpd12:15:132
318299987,1cyclictest743-21snmpd10:17:562
318299987,1cyclictest741-21lldpd10:49:392
318299986,2cyclictest743-21snmpd12:20:272
318299986,2cyclictest743-21snmpd10:27:482
318299986,2cyclictest743-21snmpd08:39:442
318299986,2cyclictest743-21snmpd08:22:252
318249988,0cyclictest741-21lldpd07:51:011
318249987,1cyclictest522-21avahi-daemon08:21:201
318229988,0cyclictest743-21snmpd11:35:170
318229988,0cyclictest743-21snmpd10:07:110
318229988,0cyclictest743-21snmpd09:42:220
318229988,0cyclictest743-21snmpd07:25:260
318229988,0cyclictest743-21snmpd07:12:230
318229988,0cyclictest741-21lldpd10:30:150
318229988,0cyclictest741-21lldpd08:53:160
318229988,0cyclictest741-21lldpd07:37:490
318229987,1cyclictest743-21snmpd08:46:590
318229987,1cyclictest743-21snmpd08:29:190
318229987,1cyclictest741-21lldpd09:37:180
318229987,1cyclictest741-21lldpd09:03:420
318229986,2cyclictest743-21snmpd10:37:270
318369977,0cyclictest743-21snmpd11:50:293
318369977,0cyclictest741-21lldpd11:57:323
318369977,0cyclictest741-21lldpd10:32:273
318369977,0cyclictest741-21lldpd10:26:233
318369977,0cyclictest741-21lldpd10:17:253
318369977,0cyclictest741-21lldpd09:23:303
318369977,0cyclictest741-21lldpd08:00:353
318369977,0cyclictest741-21lldpd07:44:473
318369976,1cyclictest743-21snmpd08:15:073
318369976,1cyclictest741-21lldpd07:57:313
318369975,2cyclictest743-21snmpd12:11:333
318369975,2cyclictest743-21snmpd08:25:103
318369974,2cyclictest743-21snmpd11:40:083
318299977,0cyclictest743-21snmpd12:29:282
318299977,0cyclictest743-21snmpd10:20:292
318299977,0cyclictest743-21snmpd09:37:042
318299977,0cyclictest743-21snmpd08:15:252
318299977,0cyclictest741-21lldpd11:55:202
318299977,0cyclictest741-21lldpd11:42:502
318299977,0cyclictest741-21lldpd10:50:152
318299977,0cyclictest741-21lldpd10:00:232
318299977,0cyclictest741-21lldpd09:42:462
318299977,0cyclictest741-21lldpd09:25:542
318299977,0cyclictest741-21lldpd09:13:242
318299976,1cyclictest743-21snmpd11:27:502
318299976,1cyclictest741-21lldpd12:02:532
318299976,1cyclictest741-21lldpd11:24:542
318299976,1cyclictest741-21lldpd11:16:282
318299975,2cyclictest743-21snmpd12:09:242
318299975,2cyclictest743-21snmpd11:54:092
318299975,2cyclictest743-21snmpd09:02:362
318299975,2cyclictest743-21snmpd07:39:272
318299975,2cyclictest743-21snmpd07:34:592
318299975,2cyclictest14684-21cat07:45:142
318229977,0cyclictest743-21snmpd12:30:430
318229977,0cyclictest743-21snmpd10:46:300
318229977,0cyclictest743-21snmpd10:11:500
318229977,0cyclictest743-21snmpd09:48:580
318229977,0cyclictest743-21snmpd08:31:220
318229977,0cyclictest741-21lldpd12:11:170
318229977,0cyclictest741-21lldpd11:14:300
318229977,0cyclictest522-21avahi-daemon10:53:210
318229976,1cyclictest741-21lldpd11:28:340
318229976,1cyclictest741-21lldpd07:53:130
318229976,1cyclictest522-21avahi-daemon07:45:240
318229976,1cyclictest3940-21ntp_offset11:15:170
318229976,1cyclictest27547-21ntp_kernel_pll_08:15:160
318229975,2cyclictest743-21snmpd08:56:260
318369966,0cyclictest741-21lldpd10:07:013
318369966,0cyclictest741-21lldpd08:49:443
318369966,0cyclictest741-21lldpd08:14:073
318369965,1cyclictest743-21snmpd10:37:003
318369965,1cyclictest743-21snmpd09:30:103
318369965,1cyclictest743-21snmpd08:36:593
318369965,1cyclictest743-21snmpd07:30:163
318369965,1cyclictest741-21lldpd09:35:063
318369965,1cyclictest741-21lldpd07:15:083
318369964,2cyclictest743-21snmpd12:22:153
318369964,2cyclictest743-21snmpd11:38:173
318369964,2cyclictest743-21snmpd10:20:383
318369962,3cyclictest32515-21users09:45:213
318369962,3cyclictest21524-21memory10:40:143
318299966,0cyclictest741-21lldpd09:56:452
318299966,0cyclictest741-21lldpd08:32:012
318299966,0cyclictest741-21lldpd08:12:092
318299966,0cyclictest522-21avahi-daemon12:32:382
318299966,0cyclictest522-21avahi-daemon11:08:552
318299966,0cyclictest2029-21cut07:15:132
318299965,1cyclictest743-21snmpd10:07:382
318299965,1cyclictest522-21avahi-daemon08:55:292
318299965,1cyclictest25171-21cpuspeed_turbos09:30:122
318299965,1cyclictest18810-21fschecks_count09:15:122
318299965,1cyclictest1-21systemd09:48:502
318299964,2cyclictest743-21snmpd08:51:592
318299963,3cyclictest4776-21awk12:35:192
318299962,3cyclictest28263-21grep10:55:202
318249966,0cyclictest743-21snmpd08:17:401
318229966,0cyclictest743-21snmpd11:21:530
318229966,0cyclictest743-21snmpd09:17:120
318229966,0cyclictest743-21snmpd08:20:130
318229966,0cyclictest741-21lldpd10:41:550
318229966,0cyclictest741-21lldpd07:33:410
318229965,1cyclictest862-21cpuspeed_turbos09:50:120
318229965,1cyclictest743-21snmpd12:05:480
318229965,1cyclictest743-21snmpd11:45:270
318229965,1cyclictest743-21snmpd10:26:110
318229965,1cyclictest14846-21fschecks_time09:05:130
318229964,2cyclictest743-21snmpd12:21:300
318229964,2cyclictest743-21snmpd11:43:350
318229964,2cyclictest743-21snmpd10:23:140
318229964,2cyclictest743-21snmpd10:04:560
318229964,2cyclictest743-21snmpd09:26:570
318229964,2cyclictest743-21snmpd07:41:030
318229963,3cyclictest9893-21perl11:30:130
318229963,3cyclictest20606-21fw_forwarded_lo08:00:130
318229962,3cyclictest29428-21smartctl11:00:130
318229962,2cyclictest22459-21cat09:25:000
318229961,5cyclictest557-21NetworkManager08:12:300
318369955,0cyclictest743-21snmpd10:46:033
318369955,0cyclictest741-21lldpd12:17:383
318369955,0cyclictest741-21lldpd08:52:303
318369954,1cyclictest743-21snmpd09:41:373
318369954,1cyclictest522-21avahi-daemon09:14:293
318369954,1cyclictest1622-21ntp_states09:50:173
318369953,2cyclictest7590-21apt-get11:25:103
318369953,2cyclictest743-21snmpd12:05:213
318369953,2cyclictest511ktimers/307:35:113
318369952,3cyclictest5791-21sort07:25:013
318369952,3cyclictest557-21NetworkManager09:00:553
318369952,2cyclictest6141-21grep11:20:133
318369952,2cyclictest29588-21load11:00:143
318369952,2cyclictest244-20systemd-journal12:39:123
318369950,5cyclictest15351-21ntpq09:05:163
318369950,4cyclictest6248-21latency_hist08:45:003
318369950,4cyclictest1292-21ntpq08:30:173
318369950,3cyclictest5070-21cat11:20:003
318299955,0cyclictest743-21snmpd09:09:302
318299955,0cyclictest741-21lldpd10:11:112
318299954,1cyclictest1402-21gltestperf11:10:132
318299953,2cyclictest743-21snmpd08:47:442
318299953,2cyclictest743-21snmpd07:51:032
318299953,1cyclictest20689-21sendmail10:40:002
318299952,3cyclictest743-21snmpd09:20:122
318299952,2cyclictest5786-21grep08:40:212
318299951,3cyclictest27220-21seq12:11:522
318299950,4cyclictest31629-21ntpq08:25:192
318229955,0cyclictest522-21avahi-daemon09:57:030
318229954,1cyclictest743-21snmpd08:41:020
318229954,1cyclictest743-21snmpd08:06:210
318229954,1cyclictest522-21avahi-daemon10:58:290
318229954,1cyclictest22011-21gltestperf12:00:130
318229953,2cyclictest743-21snmpd12:25:130
318229953,2cyclictest743-21snmpd07:23:440
318229952,3cyclictest557-21NetworkManager07:17:510
318229950,4cyclictest19105-21ntpq07:55:160
318229950,4cyclictest16892-21gltestperf09:10:130
318369943,1cyclictest743-21snmpd07:20:173
318369942,2cyclictest557-21NetworkManager10:13:563
318369942,2cyclictest22911-21df_inode08:05:133
318369941,2cyclictest22757-21awk09:25:003
318369941,2cyclictest10200-21ls11:30:143
318369940,4cyclictest32021-21apt-get07:10:113
318369940,3cyclictest4999-21diskstats10:00:123
318369940,3cyclictest28374-21sshd10:55:273
318369940,3cyclictest19439-21ntp_states09:15:163
318369940,3cyclictest11093-21memory08:55:143
318299942,2cyclictest9964-21sed11:30:122
318299941,2cyclictest12651-21sort07:40:132
318299941,2cyclictest12494-21nvmesmart_nvme011:35:162
318299940,3cyclictest1405-21/usr/sbin/munin09:50:152
318229942,2cyclictest20396-21ntpq11:55:150
318229941,2cyclictest27993-21grep12:15:120
318229940,3cyclictest3207-21ntpq08:35:160
318229940,0cyclictest0-21swapper/011:50:000
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional