You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-30 - 14:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack8slot6s.osadl.org (updated Sun Nov 30, 2025 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27954993333,0cyclictest3952-21fwupd07:29:390
27958991918,1cyclictest66850irq/125-lan12:14:321
27958991918,1cyclictest66850irq/125-lan11:30:111
27958991918,1cyclictest66850irq/125-lan09:58:491
27958991918,1cyclictest66850irq/125-lan09:25:131
27958991918,1cyclictest66850irq/125-lan09:22:241
27958991918,1cyclictest66850irq/125-lan09:17:201
27958991918,1cyclictest66850irq/125-lan07:40:211
27958991818,0cyclictest66850irq/125-lan12:01:391
27958991818,0cyclictest66850irq/125-lan11:06:421
27958991818,0cyclictest66850irq/125-lan09:36:131
27958991817,1cyclictest66850irq/125-lan12:25:231
27958991817,1cyclictest66850irq/125-lan12:25:231
27958991817,1cyclictest66850irq/125-lan12:15:191
27958991817,1cyclictest66850irq/125-lan11:55:001
27958991817,1cyclictest66850irq/125-lan11:40:511
27958991817,1cyclictest66850irq/125-lan11:20:561
27958991817,1cyclictest66850irq/125-lan11:11:431
27958991817,1cyclictest66850irq/125-lan10:56:221
27958991817,1cyclictest66850irq/125-lan10:48:201
27958991817,1cyclictest66850irq/125-lan10:10:271
27958991817,1cyclictest66850irq/125-lan08:48:241
27958991717,0cyclictest66850irq/125-lan10:35:271
27958991717,0cyclictest66850irq/125-lan10:30:001
27958991717,0cyclictest66850irq/125-lan10:21:591
27958991717,0cyclictest66850irq/125-lan10:15:121
27958991717,0cyclictest66850irq/125-lan10:05:521
27958991717,0cyclictest66850irq/125-lan09:41:521
27958991717,0cyclictest66850irq/125-lan08:55:121
27958991717,0cyclictest66850irq/125-lan08:10:241
27958991717,0cyclictest66850irq/125-lan07:20:211
27958991716,1cyclictest66850irq/125-lan12:36:081
27958991716,1cyclictest66850irq/125-lan12:31:061
27958991716,1cyclictest66850irq/125-lan12:05:571
27958991716,1cyclictest66850irq/125-lan11:45:401
27958991716,1cyclictest66850irq/125-lan11:36:231
27958991716,1cyclictest66850irq/125-lan11:18:231
27958991716,1cyclictest66850irq/125-lan11:00:251
27958991716,1cyclictest66850irq/125-lan10:50:241
27958991716,1cyclictest66850irq/125-lan10:40:241
27958991716,1cyclictest66850irq/125-lan10:00:161
27958991716,1cyclictest66850irq/125-lan09:50:161
27958991716,1cyclictest66850irq/125-lan09:30:161
27958991716,1cyclictest66850irq/125-lan09:10:481
27958991716,1cyclictest66850irq/125-lan08:50:131
27958991716,1cyclictest66850irq/125-lan07:55:181
27958991716,1cyclictest66850irq/125-lan07:10:151
27958991616,0cyclictest66850irq/125-lan10:27:181
27958991615,1cyclictest66850irq/125-lan12:20:111
27958991615,1cyclictest66850irq/125-lan11:55:061
27958991615,1cyclictest66850irq/125-lan11:25:171
27958991615,1cyclictest66850irq/125-lan08:24:391
27958991615,1cyclictest66850irq/125-lan08:00:191
27958991615,1cyclictest66850irq/125-lan07:35:231
27958991615,1cyclictest66850irq/125-lan07:30:141
27963991515,0cyclictest771-21snmpd11:57:422
27963991515,0cyclictest2665-21cat07:25:152
27958991515,0cyclictest66850irq/125-lan08:40:151
27958991514,1cyclictest66850irq/125-lan09:46:191
27958991514,1cyclictest66850irq/125-lan08:30:171
27963991414,0cyclictest771-21snmpd08:10:152
27958991414,0cyclictest66850irq/125-lan07:15:131
27958991413,1cyclictest66850irq/125-lan08:15:151
27958991413,1cyclictest66850irq/125-lan07:25:171
27963991313,0cyclictest771-21snmpd07:58:242
27963991312,1cyclictest2415-21kworker/2:1+events10:32:502
27958991312,1cyclictest66850irq/125-lan09:00:121
27958991312,1cyclictest66850irq/125-lan07:50:141
27958991312,1cyclictest66850irq/125-lan07:45:181
27963991212,0cyclictest771-21snmpd12:05:592
27963991212,0cyclictest771-21snmpd08:03:252
27963991212,0cyclictest771-21snmpd07:45:172
27963991111,0cyclictest9230-21cat07:40:172
27963991111,0cyclictest771-21snmpd10:40:472
27963991111,0cyclictest771-21snmpd09:57:462
27963991111,0cyclictest771-21snmpd07:11:402
27963991111,0cyclictest3358-21cat09:35:152
27963991110,1cyclictest771-21snmpd10:19:592
27963991110,1cyclictest2415-21kworker/2:1+events11:42:392
27963991110,1cyclictest2415-21kworker/2:1+events09:26:552
27958991111,0cyclictest66850irq/125-lan08:05:141
27963991010,0cyclictest771-21snmpd12:15:362
27963991010,0cyclictest771-21snmpd11:25:472
27963991010,0cyclictest771-21snmpd10:52:152
27963991010,0cyclictest771-21snmpd10:12:042
27963991010,0cyclictest771-21snmpd09:11:082
27963991010,0cyclictest771-21snmpd08:26:102
27958991010,0cyclictest66850irq/125-lan09:07:401
279669998,1cyclictest769-21lldpd09:46:473
279669998,1cyclictest524-21avahi-daemon12:00:063
279669998,1cyclictest524-21avahi-daemon09:55:283
279669997,2cyclictest771-21snmpd09:29:393
279639999,0cyclictest771-21snmpd09:01:202
279639999,0cyclictest771-21snmpd08:45:192
279639999,0cyclictest771-21snmpd07:51:512
279639998,1cyclictest771-21snmpd10:21:482
279589998,1cyclictest66850irq/125-lan08:25:151
279549998,1cyclictest771-21snmpd11:58:030
279549998,1cyclictest771-21snmpd10:00:010
279549998,1cyclictest771-21snmpd09:41:030
279669988,0cyclictest771-21snmpd11:16:253
279669988,0cyclictest771-21snmpd08:30:053
279669988,0cyclictest771-21snmpd07:58:393
279669988,0cyclictest769-21lldpd11:30:023
279669988,0cyclictest769-21lldpd11:22:533
279669988,0cyclictest769-21lldpd10:47:323
279669987,1cyclictest524-21avahi-daemon09:34:403
279669987,1cyclictest517-21systemd-resolve09:43:303
279669986,2cyclictest771-21snmpd10:44:273
279669986,2cyclictest771-21snmpd08:26:163
279669986,2cyclictest771-21snmpd07:21:053
279669986,2cyclictest28567-21cat07:10:143
279639988,0cyclictest771-21snmpd11:50:442
279639988,0cyclictest771-21snmpd11:31:132
279639988,0cyclictest769-21lldpd12:36:062
279639988,0cyclictest769-21lldpd11:45:592
279639988,0cyclictest769-21lldpd10:30:002
279639987,1cyclictest2415-21kworker/2:1+events09:34:522
279639986,2cyclictest771-21snmpd12:02:502
279639986,2cyclictest749-21ntpd12:14:312
279639986,2cyclictest3922-21cat12:30:142
279639986,2cyclictest30582-21cat07:15:162
279549988,0cyclictest771-21snmpd12:13:240
279549988,0cyclictest769-21lldpd12:27:180
279549988,0cyclictest769-21lldpd12:27:170
279549988,0cyclictest769-21lldpd10:50:360
279549988,0cyclictest769-21lldpd10:40:350
279549988,0cyclictest769-21lldpd10:37:400
279549988,0cyclictest769-21lldpd07:58:290
279549988,0cyclictest769-21lldpd07:42:230
279549988,0cyclictest769-21lldpd07:21:450
279549987,1cyclictest771-21snmpd12:17:220
279549987,1cyclictest771-21snmpd11:26:020
279549987,1cyclictest771-21snmpd10:57:550
279549987,1cyclictest771-21snmpd08:49:380
279549987,1cyclictest769-21lldpd08:33:000
279549987,1cyclictest517-21systemd-resolve10:09:220
279549987,1cyclictest255-20systemd-journal11:48:300
279549986,2cyclictest771-21snmpd12:01:060
279549986,2cyclictest771-21snmpd08:21:460
279549986,2cyclictest771-21snmpd07:52:000
279669977,0cyclictest771-21snmpd12:26:013
279669977,0cyclictest771-21snmpd12:26:003
279669977,0cyclictest771-21snmpd08:55:143
279669977,0cyclictest771-21snmpd08:44:463
279669977,0cyclictest769-21lldpd12:10:283
279669977,0cyclictest769-21lldpd10:55:363
279669977,0cyclictest769-21lldpd08:23:243
279669977,0cyclictest769-21lldpd08:02:173
279669977,0cyclictest524-21avahi-daemon12:05:223
279669976,1cyclictest771-21snmpd11:12:043
279669976,1cyclictest771-21snmpd10:04:103
279669976,1cyclictest769-21lldpd10:14:593
279669976,1cyclictest524-21avahi-daemon07:35:183
279669976,1cyclictest31364-21gltestperf08:35:143
279669976,1cyclictest12897-21cpuspeed_turbos07:50:133
279669975,2cyclictest771-21snmpd09:07:173
279669975,2cyclictest771-21snmpd09:00:173
279639977,0cyclictest771-21snmpd09:52:202
279639977,0cyclictest771-21snmpd08:44:252
279639977,0cyclictest769-21lldpd09:40:312
279639976,1cyclictest771-21snmpd09:21:402
279639976,1cyclictest771-21snmpd08:58:052
279639976,1cyclictest771-21snmpd08:36:552
279639976,1cyclictest769-21lldpd07:23:232
279639976,1cyclictest749-21ntpd10:37:592
279639976,1cyclictest749-21ntpd10:05:532
279639976,1cyclictest4934-21needreboot07:30:152
279639975,2cyclictest771-21snmpd12:25:102
279639975,2cyclictest771-21snmpd12:25:092
279639975,2cyclictest771-21snmpd09:15:482
279639975,2cyclictest749-21ntpd11:14:302
279639975,2cyclictest749-21ntpd10:55:162
279639975,2cyclictest749-21ntpd10:48:202
279639973,3cyclictest30821-21ssh11:17:432
279549977,0cyclictest771-21snmpd11:32:100
279549977,0cyclictest769-21lldpd08:00:010
279549977,0cyclictest769-21lldpd07:49:590
279549977,0cyclictest769-21lldpd07:34:580
279549976,1cyclictest771-21snmpd08:38:580
279549976,1cyclictest524-21avahi-daemon11:50:380
279549976,1cyclictest524-21avahi-daemon11:21:230
279549976,1cyclictest517-21systemd-resolve09:49:000
279549975,2cyclictest771-21snmpd09:15:120
279549975,2cyclictest771-21snmpd08:12:090
279549973,3cyclictest24087-21ssh09:21:470
279669966,0cyclictest769-21lldpd11:27:313
279669965,1cyclictest771-21snmpd11:42:363
279669965,1cyclictest771-21snmpd08:11:303
279669965,1cyclictest524-21avahi-daemon11:45:303
279669965,1cyclictest255-20systemd-journal07:49:383
279669964,2cyclictest771-21snmpd10:30:443
279669964,2cyclictest771-21snmpd08:18:073
279669963,3cyclictest550-21NetworkManager12:18:303
279669963,3cyclictest550-21NetworkManager11:56:293
279669963,3cyclictest31570-21df10:05:153
279669963,2cyclictest771-21snmpd09:12:113
279669963,2cyclictest586-21rs:main3
279669963,2cyclictest5185-21ssh12:30:433
279669963,2cyclictest255-20systemd-journal10:27:313
279669963,2cyclictest24597-21ssh09:22:383
279669962,3cyclictest29148-21ssh12:22:473
279669962,3cyclictest12663-21ssh10:20:093
279639966,0cyclictest769-21lldpd09:47:272
279639965,1cyclictest771-21snmpd10:02:522
279639965,1cyclictest255-20systemd-journal11:02:112
279639964,2cyclictest771-21snmpd08:33:322
279639963,2cyclictest255-20systemd-journal11:20:372
279589966,0cyclictest66850irq/125-lan08:38:071
279549966,0cyclictest771-21snmpd10:17:080
279549965,1cyclictest771-21snmpd09:32:450
279549965,1cyclictest771-21snmpd09:03:230
279549965,1cyclictest769-21lldpd11:16:560
279549965,1cyclictest524-21avahi-daemon10:30:590
279549965,1cyclictest524-21avahi-daemon10:20:280
279549965,1cyclictest524-21avahi-daemon08:26:450
279549964,2cyclictest771-21snmpd12:30:270
279549964,2cyclictest771-21snmpd11:08:360
279549964,2cyclictest771-21snmpd08:57:560
279549964,2cyclictest771-21snmpd08:54:510
279549963,3cyclictest255-20systemd-journal11:01:510
279549963,2cyclictest7272-21ssh10:14:080
279549963,2cyclictest255-20systemd-journal09:37:100
279549962,4cyclictest550-21NetworkManager09:07:020
279549962,3cyclictest7271-21memory07:35:170
279549962,3cyclictest29464-21ssh12:23:140
279549962,3cyclictest23967-21ssh11:10:100
279549962,3cyclictest14531-21ssh09:10:440
279549962,3cyclictest12957-21ssh12:06:100
279669954,1cyclictest769-21lldpd10:15:133
279669953,2cyclictest771-21snmpd08:50:293
279669953,2cyclictest771-21snmpd08:07:213
279669953,2cyclictest771-21snmpd07:26:053
279669953,2cyclictest3685-21ntpq09:35:163
279669952,2cyclictest9091-21cut07:40:163
279669952,2cyclictest8704-21ssh10:50:513
279669952,2cyclictest586-21rs:main3
279669952,2cyclictest28979-21ld11:50:153
279669952,2cyclictest20679-21ssh11:05:283
279669952,2cyclictest17296-21ssh11:00:413
279669951,2cyclictest21536-21cat09:20:003
279669950,4cyclictest27464-21ntpq10:35:183
279639955,0cyclictest769-21lldpd08:24:582
279639954,1cyclictest2415-21kworker/2:1+events12:20:202
279639953,2cyclictest749-21ntpd11:06:432
279639953,2cyclictest749-21ntpd09:05:172
279639953,2cyclictest749-21ntpd08:50:182
279639952,2cyclictest19629-21awk08:05:172
279639952,2cyclictest14372-21if_lan11:35:152
279639951,4cyclictest550-21NetworkManager07:39:222
279549955,0cyclictest769-21lldpd08:42:280
279549955,0cyclictest769-21lldpd08:17:160
279549954,1cyclictest171ktimers/009:50:550
279549953,2cyclictest749-21ntpd10:45:020
279549953,2cyclictest749-21ntpd09:25:530
279549953,2cyclictest550-21NetworkManager11:35:540
279549953,2cyclictest0-21swapper/012:36:030
279549952,3cyclictest771-21snmpd07:10:580
279549952,3cyclictest30952-21awk07:15:190
279549951,3cyclictest23227-21cat09:55:230
279549951,3cyclictest20186-21ssh11:41:110
279549950,4cyclictest19620-21ntpq08:05:170
279549950,4cyclictest18315-21cat10:25:170
279669944,0cyclictest769-21lldpd07:32:353
279669942,2cyclictest14409-21uname11:35:153
279669940,4cyclictest749-21ntpd07:15:133
279669940,3cyclictest2822-21diskstats08:45:143
279639942,2cyclictest586-21rs:main2
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional