You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-14 - 23:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Wed May 14, 2025 12:43:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28838992019,1cyclictest65850irq/126-lan09:10:182
28838991918,1cyclictest65850irq/126-lan12:37:502
28838991918,1cyclictest65850irq/126-lan12:00:182
28838991918,1cyclictest65850irq/126-lan11:31:552
28838991918,1cyclictest65850irq/126-lan10:43:542
28838991918,1cyclictest65850irq/126-lan10:13:282
28838991918,1cyclictest65850irq/126-lan09:41:322
28838991918,1cyclictest65850irq/126-lan08:40:112
28838991818,0cyclictest65850irq/126-lan12:15:302
28838991818,0cyclictest65850irq/126-lan11:45:502
28838991818,0cyclictest65850irq/126-lan09:48:062
28838991818,0cyclictest65850irq/126-lan09:05:192
28838991817,1cyclictest65850irq/126-lan12:10:142
28838991817,1cyclictest65850irq/126-lan12:05:382
28838991817,1cyclictest65850irq/126-lan11:26:322
28838991817,1cyclictest65850irq/126-lan10:55:432
28838991817,1cyclictest65850irq/126-lan10:19:242
28838991817,1cyclictest65850irq/126-lan10:00:152
28838991817,1cyclictest65850irq/126-lan09:55:182
28838991817,1cyclictest65850irq/126-lan09:30:162
28838991817,1cyclictest65850irq/126-lan09:25:062
28838991817,1cyclictest65850irq/126-lan09:19:122
28838991817,1cyclictest65850irq/126-lan08:10:172
28838991816,1cyclictest65850irq/126-lan11:40:132
28838991717,0cyclictest65850irq/126-lan12:22:052
28838991717,0cyclictest65850irq/126-lan11:37:092
28838991717,0cyclictest65850irq/126-lan11:24:452
28838991717,0cyclictest65850irq/126-lan11:15:162
28838991717,0cyclictest65850irq/126-lan10:50:222
28838991717,0cyclictest65850irq/126-lan10:35:132
28838991717,0cyclictest65850irq/126-lan10:29:142
28838991717,0cyclictest65850irq/126-lan09:22:212
28838991717,0cyclictest65850irq/126-lan07:52:092
28838991716,1cyclictest65850irq/126-lan12:32:502
28838991716,1cyclictest65850irq/126-lan12:28:022
28838991716,1cyclictest65850irq/126-lan11:55:152
28838991716,1cyclictest65850irq/126-lan11:01:452
28838991716,1cyclictest65850irq/126-lan10:23:012
28838991716,1cyclictest65850irq/126-lan10:07:332
28838991716,1cyclictest65850irq/126-lan08:30:192
28838991616,0cyclictest65850irq/126-lan11:50:112
28838991616,0cyclictest65850irq/126-lan11:10:232
28838991616,0cyclictest65850irq/126-lan10:45:572
28838991616,0cyclictest65850irq/126-lan08:00:122
28838991615,1cyclictest65850irq/126-lan09:34:592
28838991615,1cyclictest65850irq/126-lan09:01:102
28838991615,1cyclictest65850irq/126-lan07:30:152
28838991515,0cyclictest65850irq/126-lan11:05:312
28838991515,0cyclictest65850irq/126-lan10:32:362
28838991514,1cyclictest65850irq/126-lan09:50:412
28838991514,1cyclictest65850irq/126-lan08:47:102
28838991514,1cyclictest65850irq/126-lan07:20:132
28838991414,0cyclictest65850irq/126-lan07:45:132
28838991414,0cyclictest65850irq/126-lan07:10:192
28838991413,1cyclictest65850irq/126-lan08:55:152
28838991312,1cyclictest65850irq/126-lan07:40:002
28838991212,0cyclictest65850irq/126-lan08:20:142
28838991212,0cyclictest65850irq/126-lan08:15:172
28838991211,1cyclictest65850irq/126-lan08:35:152
28838991111,0cyclictest65850irq/126-lan08:05:142
28838991111,0cyclictest65850irq/126-lan07:40:082
28838991110,1cyclictest65850irq/126-lan07:15:192
288419998,1cyclictest506-21avahi-daemon11:25:263
288419996,2cyclictest20800-21cut08:20:133
288389998,1cyclictest65850irq/126-lan08:50:222
288329998,1cyclictest765-21snmpd09:53:451
288329998,1cyclictest506-21avahi-daemon12:09:491
288329996,3cyclictest765-21snmpd07:57:141
288269998,1cyclictest765-21snmpd12:08:220
288269998,1cyclictest765-21snmpd10:59:440
288269998,1cyclictest765-21snmpd10:11:260
288269998,1cyclictest254-20systemd-journal11:11:010
288419988,0cyclictest765-21snmpd12:19:563
288419988,0cyclictest765-21snmpd11:10:443
288419988,0cyclictest765-21snmpd09:07:343
288419988,0cyclictest765-21snmpd08:38:513
288419988,0cyclictest763-21lldpd12:02:563
288419988,0cyclictest763-21lldpd11:38:383
288419988,0cyclictest763-21lldpd08:34:063
288419987,1cyclictest765-21snmpd12:10:433
288419987,1cyclictest765-21snmpd09:55:153
288419987,1cyclictest506-21avahi-daemon11:19:303
288419987,1cyclictest506-21avahi-daemon09:46:453
288419987,1cyclictest499-21systemd-resolve09:27:253
288419986,2cyclictest765-21snmpd10:37:553
288419986,2cyclictest765-21snmpd10:32:103
288419986,2cyclictest765-21snmpd09:00:583
288389987,1cyclictest65850irq/126-lan08:25:152
288389987,1cyclictest65850irq/126-lan07:25:002
288329988,0cyclictest765-21snmpd12:35:411
288329988,0cyclictest765-21snmpd11:10:171
288329988,0cyclictest765-21snmpd07:23:131
288329988,0cyclictest763-21lldpd09:28:001
288329988,0cyclictest763-21lldpd08:08:061
288329987,1cyclictest765-21snmpd12:32:381
288329987,1cyclictest765-21snmpd09:43:411
288329987,1cyclictest765-21snmpd07:15:061
288329987,1cyclictest763-21lldpd09:15:591
288329987,1cyclictest747-21in:imuxsock10:55:001
288329987,1cyclictest506-21avahi-daemon10:30:451
288329987,1cyclictest282-21systemd-udevd11:21:011
288329987,1cyclictest18892-21cut11:30:151
288329986,2cyclictest765-21snmpd09:23:521
288329986,2cyclictest765-21snmpd08:23:061
288269988,0cyclictest765-21snmpd12:26:530
288269988,0cyclictest765-21snmpd11:01:200
288269988,0cyclictest765-21snmpd10:32:550
288269988,0cyclictest765-21snmpd10:01:090
288269988,0cyclictest763-21lldpd12:34:180
288269988,0cyclictest763-21lldpd10:38:110
288269988,0cyclictest763-21lldpd09:36:240
288269988,0cyclictest763-21lldpd09:17:190
288269988,0cyclictest763-21lldpd07:56:180
288269987,1cyclictest765-21snmpd08:03:260
288269987,1cyclictest763-21lldpd07:30:470
288269987,1cyclictest506-21avahi-daemon12:35:010
288269987,1cyclictest499-21systemd-resolve09:23:210
288269986,2cyclictest765-21snmpd12:04:190
288269986,2cyclictest765-21snmpd10:47:080
288269986,2cyclictest765-21snmpd08:58:550
288269986,2cyclictest765-21snmpd08:13:140
288269985,3cyclictest765-21snmpd11:52:580
288269985,3cyclictest1423-21dump-pmu-power07:25:000
288419977,0cyclictest765-21snmpd12:36:593
288419977,0cyclictest765-21snmpd10:55:083
288419977,0cyclictest765-21snmpd10:48:413
288419977,0cyclictest765-21snmpd08:47:113
288419977,0cyclictest765-21snmpd08:28:333
288419977,0cyclictest763-21lldpd12:29:403
288419977,0cyclictest763-21lldpd08:50:333
288419977,0cyclictest763-21lldpd08:16:273
288419977,0cyclictest506-21avahi-daemon09:20:143
288419977,0cyclictest499-21systemd-resolve11:50:493
288419976,1cyclictest765-21snmpd11:22:183
288419976,1cyclictest763-21lldpd10:09:473
288419976,1cyclictest763-21lldpd07:24:063
288419976,1cyclictest506-21avahi-daemon12:21:273
288419976,1cyclictest506-21avahi-daemon11:30:303
288419976,1cyclictest20527-21fschecks_time09:30:133
288419975,2cyclictest765-21snmpd07:32:223
288419973,3cyclictest30580-21ssh11:45:143
288419972,5cyclictest530-21NetworkManager07:57:033
288329977,0cyclictest765-21snmpd12:21:381
288329977,0cyclictest765-21snmpd12:02:311
288329977,0cyclictest765-21snmpd10:26:511
288329977,0cyclictest765-21snmpd07:54:591
288329977,0cyclictest763-21lldpd11:40:461
288329977,0cyclictest763-21lldpd10:41:511
288329977,0cyclictest763-21lldpd10:05:281
288329977,0cyclictest763-21lldpd09:46:281
288329977,0cyclictest763-21lldpd08:59:491
288329977,0cyclictest506-21avahi-daemon08:25:421
288329976,1cyclictest765-21snmpd08:49:341
288329976,1cyclictest765-21snmpd08:19:151
288329976,1cyclictest765-21snmpd08:01:071
288329976,1cyclictest570-21gmain09:39:081
288329976,1cyclictest506-21avahi-daemon12:15:411
288329976,1cyclictest3504-21cpuspeed_turbos09:05:121
288329975,2cyclictest765-21snmpd07:11:461
288329973,3cyclictest7068-21ssh09:11:511
288329973,3cyclictest1690-21apt07:25:131
288269977,0cyclictest765-21snmpd10:26:250
288269977,0cyclictest765-21snmpd09:26:590
288269977,0cyclictest765-21snmpd09:11:070
288269977,0cyclictest765-21snmpd09:05:540
288269977,0cyclictest765-21snmpd08:53:330
288269977,0cyclictest765-21snmpd08:21:440
288269977,0cyclictest765-21snmpd07:35:100
288269977,0cyclictest763-21lldpd12:20:500
288269977,0cyclictest763-21lldpd09:03:050
288269977,0cyclictest763-21lldpd07:15:210
288269977,0cyclictest763-21lldpd07:13:060
288269976,1cyclictest765-21snmpd08:39:110
288269976,1cyclictest765-21snmpd07:43:350
288269976,1cyclictest763-21lldpd07:45:270
288269975,2cyclictest765-21snmpd09:41:380
288269975,2cyclictest765-21snmpd08:43:420
288269975,2cyclictest765-21snmpd07:50:170
288269974,3cyclictest765-21snmpd12:11:250
288269973,3cyclictest16342-21ntp_states08:05:190
288269972,4cyclictest18631-21apt-get11:30:140
288419966,0cyclictest765-21snmpd09:39:203
288419966,0cyclictest763-21lldpd12:07:363
288419966,0cyclictest763-21lldpd10:50:553
288419966,0cyclictest506-21avahi-daemon08:04:183
288419965,1cyclictest765-21snmpd09:51:203
288419965,1cyclictest765-21snmpd08:56:313
288419965,1cyclictest5226-21fschecks_count07:35:163
288419965,1cyclictest506-21avahi-daemon09:12:423
288419963,2cyclictest10575-21ssh09:16:283
288419962,3cyclictest6127-21memory12:30:143
288419962,3cyclictest522-21systemd-logind10:19:013
288389966,0cyclictest765-21snmpd07:59:352
288329966,0cyclictest765-21snmpd10:16:181
288329966,0cyclictest763-21lldpd10:22:361
288329966,0cyclictest763-21lldpd08:12:041
288329965,1cyclictest8020-21cpuspeed_turbos10:35:141
288329965,1cyclictest254-20systemd-journal08:40:021
288329965,1cyclictest2360-21gltestperf11:50:141
288329964,2cyclictest765-21snmpd12:12:431
288329964,2cyclictest530-21NetworkManager09:56:451
288329963,3cyclictest530-21NetworkManager11:07:101
288329963,2cyclictest254-20systemd-journal11:02:161
288329963,2cyclictest22553-21apt-get11:35:121
288329962,3cyclictest6683-21grep11:15:131
288329962,3cyclictest24089-21awk08:30:131
288269966,0cyclictest765-21snmpd08:29:240
288269966,0cyclictest763-21lldpd10:52:430
288269966,0cyclictest763-21lldpd09:53:180
288269965,1cyclictest765-21snmpd11:39:450
288269965,1cyclictest765-21snmpd11:15:390
288269965,1cyclictest765-21snmpd09:30:410
288269965,1cyclictest522-21systemd-logind10:43:010
288269964,2cyclictest765-21snmpd11:40:270
288269963,3cyclictest530-21NetworkManager10:22:350
288269963,2cyclictest8656-21ssh11:57:140
288269963,2cyclictest30905-21ssh11:45:170
288269962,3cyclictest254-20systemd-journal11:07:020
288269962,3cyclictest1659-21sshd07:25:100
288419955,0cyclictest763-21lldpd10:14:583
288419954,1cyclictest763-21lldpd08:08:083
288419954,1cyclictest511ktimers/308:40:173
288419954,1cyclictest506-21avahi-daemon11:56:343
288419954,1cyclictest506-21avahi-daemon10:00:593
288419954,1cyclictest506-21avahi-daemon07:26:553
288419953,2cyclictest765-21snmpd10:43:043
288419953,2cyclictest765-21snmpd07:42:443
288419952,3cyclictest530-21NetworkManager10:20:113
288419952,3cyclictest530-21NetworkManager09:40:513
288419952,3cyclictest30991-21perl07:15:163
288419952,3cyclictest18035-21ntp_states08:10:183
288419952,2cyclictest31771-21ssh11:05:153
288419952,2cyclictest254-20systemd-journal11:43:403
288419952,2cyclictest10960-21sed07:50:153
288419951,3cyclictest32217-21grep10:25:133
288419950,4cyclictest9211-21expr07:45:163
288329955,0cyclictest765-21snmpd07:31:481
288329955,0cyclictest763-21lldpd10:00:401
288329955,0cyclictest763-21lldpd07:37:441
288329955,0cyclictest0-21swapper/111:45:171
288329953,2cyclictest765-21snmpd07:46:281
288329952,2cyclictest7413-21grep07:40:151
288329952,2cyclictest6810-21cat11:55:151
288329952,2cyclictest31891-21seq08:51:281
288329952,2cyclictest2917-21ssh12:26:541
288329952,2cyclictest23890-21ssh10:55:011
288329952,2cyclictest21630-21ssh10:11:111
288329952,2cyclictest20322-21grep09:30:121
288329952,2cyclictest18719-21sh10:48:281
288329950,4cyclictest15320-21ntp_states11:25:191
288269955,0cyclictest765-21snmpd08:30:480
288269953,2cyclictest216-21jbd2/nvme0n1p2-808:49:100
288269952,2cyclictest9311-21ssh09:55:320
288269952,2cyclictest25175-21ssh12:15:480
288269952,2cyclictest11997-21ssh11:20:530
288269951,3cyclictest17596-21ssh10:06:100
288269950,1cyclictest2662350ssh10:18:090
288269950,0cyclictest0-21swapper/011:25:200
288419942,2cyclictest765-21snmpd07:10:123
288419940,3cyclictest28733-21ntpq11:00:183
288329942,2cyclictest26231-21needreboot08:35:171
288329941,2cyclictest554-21rs:main1
288269940,3cyclictest32319-21cp09:45:000
288269940,3cyclictest19275-21fw_packets08:15:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional