You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-29 - 23:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Mon Dec 29, 2025 12:43:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
19996991918,1cyclictest65850irq/126-lan11:23:550
19996991818,0cyclictest65850irq/126-lan10:15:210
19996991817,1cyclictest65850irq/126-lan11:35:010
19996991817,1cyclictest65850irq/126-lan11:04:280
19996991817,1cyclictest65850irq/126-lan10:20:000
19996991817,1cyclictest65850irq/126-lan10:10:180
19996991817,1cyclictest65850irq/126-lan08:55:130
19996991817,1cyclictest65850irq/126-lan08:05:140
19996991717,0cyclictest65850irq/126-lan12:35:130
19996991717,0cyclictest65850irq/126-lan11:05:200
19996991717,0cyclictest65850irq/126-lan09:09:540
19996991717,0cyclictest65850irq/126-lan08:40:180
19996991716,1cyclictest65850irq/126-lan12:08:420
19996991716,1cyclictest65850irq/126-lan10:05:120
19996991716,1cyclictest65850irq/126-lan09:04:590
19996991716,1cyclictest65850irq/126-lan07:31:280
19996991616,0cyclictest65850irq/126-lan11:55:130
19996991616,0cyclictest65850irq/126-lan10:50:110
19996991616,0cyclictest65850irq/126-lan10:00:170
19996991616,0cyclictest65850irq/126-lan07:25:170
19996991615,1cyclictest65850irq/126-lan07:45:120
19996991515,0cyclictest65850irq/126-lan12:15:160
19996991515,0cyclictest65850irq/126-lan08:21:290
19996991515,0cyclictest65850irq/126-lan08:10:230
19996991515,0cyclictest65850irq/126-lan07:40:180
19996991514,1cyclictest65850irq/126-lan11:40:160
19996991514,1cyclictest65850irq/126-lan11:25:180
19996991514,1cyclictest65850irq/126-lan11:17:310
19996991514,1cyclictest65850irq/126-lan11:10:190
19996991514,1cyclictest65850irq/126-lan09:40:220
19996991514,1cyclictest65850irq/126-lan08:15:120
19996991514,1cyclictest65850irq/126-lan07:10:130
19996991414,0cyclictest65850irq/126-lan12:30:110
19996991414,0cyclictest65850irq/126-lan11:35:180
19996991414,0cyclictest65850irq/126-lan10:55:350
19996991414,0cyclictest65850irq/126-lan10:30:330
19996991414,0cyclictest65850irq/126-lan10:25:130
19996991414,0cyclictest65850irq/126-lan09:34:290
19996991414,0cyclictest65850irq/126-lan07:50:200
19996991413,1cyclictest65850irq/126-lan10:45:170
19996991413,1cyclictest65850irq/126-lan09:58:280
19996991413,1cyclictest65850irq/126-lan07:24:290
19996991313,0cyclictest65850irq/126-lan09:15:180
19996991313,0cyclictest65850irq/126-lan08:35:170
19996991312,1cyclictest65850irq/126-lan12:10:170
19996991312,1cyclictest65850irq/126-lan12:00:180
19996991312,1cyclictest65850irq/126-lan11:50:170
19996991312,1cyclictest65850irq/126-lan09:35:180
19996991312,1cyclictest65850irq/126-lan09:30:000
19996991312,1cyclictest65850irq/126-lan08:45:160
19996991312,1cyclictest65850irq/126-lan08:00:130
19996991312,1cyclictest65850irq/126-lan07:55:270
19996991312,1cyclictest65850irq/126-lan07:15:170
19996991311,1cyclictest65850irq/126-lan08:25:140
19996991212,0cyclictest65850irq/126-lan12:25:130
19996991212,0cyclictest65850irq/126-lan10:37:280
19996991212,0cyclictest65850irq/126-lan09:50:130
19996991111,0cyclictest65850irq/126-lan12:20:180
19996991111,0cyclictest65850irq/126-lan09:20:110
19996991111,0cyclictest65850irq/126-lan07:37:290
19996991010,0cyclictest65850irq/126-lan11:45:130
19996991010,0cyclictest65850irq/126-lan10:40:270
200109998,1cyclictest743-21snmpd10:50:183
200109998,1cyclictest743-21snmpd07:24:153
200109998,1cyclictest741-21lldpd07:32:593
200029998,1cyclictest743-21snmpd10:32:582
200029998,1cyclictest741-21lldpd11:30:132
200009998,1cyclictest741-21lldpd08:50:401
199969999,0cyclictest65850irq/126-lan09:10:170
199969999,0cyclictest65850irq/126-lan08:50:200
200109988,0cyclictest743-21snmpd12:10:213
200109988,0cyclictest743-21snmpd11:20:283
200109988,0cyclictest743-21snmpd10:08:233
200109988,0cyclictest743-21snmpd07:49:313
200109988,0cyclictest741-21lldpd12:32:593
200109988,0cyclictest741-21lldpd12:09:533
200109988,0cyclictest741-21lldpd10:32:103
200109988,0cyclictest741-21lldpd10:23:033
200109988,0cyclictest741-21lldpd09:41:193
200109988,0cyclictest741-21lldpd08:04:463
200109987,1cyclictest743-21snmpd08:24:143
200109987,1cyclictest741-21lldpd11:58:083
200109986,2cyclictest743-21snmpd10:01:593
200109986,2cyclictest743-21snmpd08:08:353
200029988,0cyclictest743-21snmpd12:18:492
200029988,0cyclictest741-21lldpd12:05:412
200029988,0cyclictest741-21lldpd11:14:492
200029987,1cyclictest743-21snmpd10:52:122
200029987,1cyclictest506-21systemd-resolve10:35:162
200029986,2cyclictest743-21snmpd10:20:412
200029986,2cyclictest743-21snmpd07:56:222
200029986,2cyclictest743-21snmpd07:10:562
200009988,0cyclictest743-21snmpd10:13:001
200009988,0cyclictest741-21lldpd12:04:211
200009988,0cyclictest741-21lldpd10:55:471
200009988,0cyclictest741-21lldpd09:50:461
200009987,1cyclictest743-21snmpd11:35:121
200009987,1cyclictest743-21snmpd09:04:331
200009987,1cyclictest743-21snmpd07:36:371
200009986,2cyclictest743-21snmpd12:05:061
200009986,2cyclictest743-21snmpd11:43:141
200009986,2cyclictest743-21snmpd08:38:391
200009986,2cyclictest743-21snmpd08:02:581
200109977,0cyclictest743-21snmpd11:50:153
200109977,0cyclictest743-21snmpd11:43:473
200109977,0cyclictest743-21snmpd10:15:093
200109977,0cyclictest743-21snmpd09:53:163
200109977,0cyclictest743-21snmpd09:39:233
200109977,0cyclictest743-21snmpd09:33:523
200109977,0cyclictest743-21snmpd09:09:373
200109977,0cyclictest743-21snmpd07:26:183
200109977,0cyclictest741-21lldpd09:00:343
200109977,0cyclictest741-21lldpd07:19:053
200109976,1cyclictest743-21snmpd10:25:093
200109976,1cyclictest741-21lldpd08:12:373
200109976,1cyclictest5669-21nvmesmart_nvme009:10:183
200109975,2cyclictest743-21snmpd09:59:153
200029977,0cyclictest743-21snmpd12:20:222
200029977,0cyclictest743-21snmpd11:54:062
200029977,0cyclictest743-21snmpd10:42:012
200029977,0cyclictest743-21snmpd10:27:362
200029977,0cyclictest743-21snmpd08:25:502
200029977,0cyclictest741-21lldpd11:23:562
200029977,0cyclictest741-21lldpd10:46:322
200029977,0cyclictest741-21lldpd10:04:512
200029977,0cyclictest741-21lldpd09:43:252
200029977,0cyclictest741-21lldpd09:13:532
200029977,0cyclictest741-21lldpd08:37:442
200029977,0cyclictest741-21lldpd08:11:192
200029977,0cyclictest741-21lldpd07:50:382
200029976,1cyclictest9117-21needreboot08:00:142
200029976,1cyclictest522-21avahi-daemon08:57:312
200029975,2cyclictest743-21snmpd12:39:472
200029975,2cyclictest743-21snmpd11:38:002
200029975,2cyclictest743-21snmpd09:34:192
200029975,2cyclictest1953-21cat11:40:162
200009977,0cyclictest743-21snmpd11:54:451
200009977,0cyclictest743-21snmpd10:49:581
200009977,0cyclictest743-21snmpd09:30:591
200009977,0cyclictest743-21snmpd09:15:091
200009977,0cyclictest743-21snmpd08:11:011
200009977,0cyclictest743-21snmpd07:28:481
200009977,0cyclictest741-21lldpd12:28:131
200009977,0cyclictest741-21lldpd09:27:591
200009977,0cyclictest741-21lldpd09:14:311
200009976,1cyclictest743-21snmpd12:21:161
200009976,1cyclictest743-21snmpd08:19:221
200009976,1cyclictest522-21avahi-daemon11:27:371
200009976,1cyclictest506-21systemd-resolve12:18:201
200009976,1cyclictest13944-21needreboot10:50:141
200009975,2cyclictest743-21snmpd08:55:581
200009975,2cyclictest743-21snmpd08:26:481
200009975,2cyclictest743-21snmpd07:12:411
200009973,3cyclictest857-21ntp_states07:40:191
199969977,0cyclictest65850irq/126-lan09:45:110
200109966,0cyclictest743-21snmpd11:19:233
200109966,0cyclictest743-21snmpd08:27:563
200109966,0cyclictest741-21lldpd12:38:103
200109966,0cyclictest522-21avahi-daemon09:27:163
200109965,1cyclictest9551-21gltestperf10:40:163
200109965,1cyclictest743-21snmpd08:39:273
200109965,1cyclictest741-21lldpd11:36:333
200109965,1cyclictest741-21lldpd11:29:273
200109965,1cyclictest522-21avahi-daemon11:06:363
200109965,1cyclictest522-21avahi-daemon09:17:433
200109965,1cyclictest25156-21cpuspeed_turbos08:40:143
200109964,2cyclictest743-21snmpd10:35:003
200109962,3cyclictest21914-21memory11:10:153
200029966,0cyclictest743-21snmpd12:14:242
200029966,0cyclictest743-21snmpd11:00:552
200029966,0cyclictest741-21lldpd10:09:262
200029966,0cyclictest741-21lldpd07:48:232
200029966,0cyclictest741-21lldpd07:29:402
200029966,0cyclictest3678-21kworker/2:1+events07:35:202
200029965,1cyclictest743-21snmpd12:01:002
200029965,1cyclictest743-21snmpd09:09:252
200029965,1cyclictest743-21snmpd09:01:182
200029965,1cyclictest743-21snmpd08:05:322
200029965,1cyclictest522-21avahi-daemon07:15:182
200029963,3cyclictest25377-21fw_forwarded_lo08:40:172
200029963,2cyclictest244-20systemd-journal08:21:352
200029960,1cyclictest23133-21awk09:54:592
200009966,0cyclictest741-21lldpd09:22:061
200009966,0cyclictest741-21lldpd07:55:571
200009965,1cyclictest743-21snmpd10:23:321
200009965,1cyclictest741-21lldpd11:07:481
200009965,1cyclictest522-21avahi-daemon11:55:491
200009965,1cyclictest522-21avahi-daemon08:44:231
200009964,2cyclictest743-21snmpd11:15:561
200009964,2cyclictest743-21snmpd07:51:431
200009964,2cyclictest743-21snmpd07:20:551
200009963,2cyclictest575-21rs:main1
200009963,2cyclictest32376-21ntp_states10:15:181
200009962,4cyclictest557-21NetworkManager08:32:121
200009962,3cyclictest5504-21fw_packets10:30:161
200009962,3cyclictest27156-21pluginstate11:25:011
200009962,3cyclictest15501-21cut09:35:131
199969962,3cyclictest20997-21hddtemp_smartct08:30:160
200109955,0cyclictest741-21lldpd11:33:033
200109954,1cyclictest743-21snmpd08:51:453
200109954,1cyclictest21247-21ntpq12:25:143
200109954,1cyclictest20235-21nvmesmart_nvme009:45:173
200109954,1cyclictest0-21swapper/308:19:593
200109953,2cyclictest743-21snmpd11:45:093
200109953,2cyclictest743-21snmpd10:55:313
200109953,2cyclictest11692-21cat10:45:143
200109952,3cyclictest743-21snmpd07:50:133
200109952,3cyclictest557-21NetworkManager11:04:333
200109952,3cyclictest32690-21fw_forwarded_lo07:40:153
200109952,2cyclictest9001-21df09:20:123
200109952,2cyclictest11133-21awk12:00:223
200109951,3cyclictest20756-21memory07:10:153
200109951,3cyclictest17765-21sed12:15:233
200029955,0cyclictest741-21lldpd11:17:162
200029955,0cyclictest522-21avahi-daemon11:49:142
200029955,0cyclictest522-21avahi-daemon08:30:542
200029954,1cyclictest20196-21ntp_states11:05:162
200029954,1cyclictest17054-21cron09:39:592
200029953,2cyclictest717-21ntpd12:25:162
200029953,2cyclictest28130-21sshd08:45:192
200029952,2cyclictest7696-21awk09:15:182
200029952,2cyclictest21153-21sed09:49:592
200029952,2cyclictest11749-21open_inodes09:25:182
200029951,3cyclictest28636-21sed07:30:152
200029951,3cyclictest15344-21awk10:55:152
200029950,4cyclictest24169-21ntpq09:55:172
200009955,0cyclictest743-21snmpd12:30:451
200009955,0cyclictest743-21snmpd07:18:001
200009955,0cyclictest741-21lldpd11:49:571
200009955,0cyclictest741-21lldpd10:37:271
200009955,0cyclictest741-21lldpd10:25:121
200009955,0cyclictest522-21avahi-daemon12:10:501
200009955,0cyclictest522-21avahi-daemon08:47:441
200009955,0cyclictest522-21avahi-daemon07:31:521
200009954,1cyclictest743-21snmpd11:30:081
200009954,1cyclictest22213-21ntpq11:10:161
200009952,2cyclictest575-21rs:main1
200009951,3cyclictest244-20systemd-journal10:05:111
200109942,2cyclictest557-21NetworkManager10:10:083
200109941,2cyclictest31631-21grep07:35:193
200109941,2cyclictest19863-21unixbench_singl12:20:223
200109940,4cyclictest6882-21ntpq07:55:173
200109940,4cyclictest21334-21ntpq08:30:183
200109940,3cyclictest31957-21ntpq08:55:193
200109940,3cyclictest27255-21diskstats08:45:113
200029944,0cyclictest0-21swapper/209:20:112
200029943,1cyclictest3678-21kworker/2:1+events11:27:112
200029942,2cyclictest717-21ntpd08:15:112
200029942,2cyclictest32603-21ls10:15:212
200029941,2cyclictest30007-21wc10:10:152
200029940,4cyclictest25076-21ntpq07:20:172
200029940,3cyclictest8274-21perl11:55:122
200029940,3cyclictest29266-21diskstats08:50:132
200029940,3cyclictest22725-21diskstats12:30:132
200009943,1cyclictest17316-21ntpq08:20:161
200009942,2cyclictest9343-21cpuspeed_turbos10:40:131
200009942,2cyclictest557-21NetworkManager09:43:441
200009941,2cyclictest743-21snmpd09:05:001
200009941,2cyclictest25451-21date10:00:011
200009941,2cyclictest23369-21cat09:55:121
200009941,2cyclictest19468-21cpuspeed_turbos09:45:121
200009940,4cyclictest25368-21ntpq12:35:171
200009940,3cyclictest10903-21hddtemp_smartct08:05:151
200029932,1cyclictest717-21ntpd07:40:082
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional