You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-02 - 12:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot6s.osadl.org (updated Fri May 02, 2025 00:43:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
15120991919,0cyclictest65850irq/126-lan22:14:132
15120991918,1cyclictest65850irq/126-lan23:40:122
15120991818,0cyclictest65850irq/126-lan23:18:172
15120991818,0cyclictest65850irq/126-lan22:59:112
15120991818,0cyclictest65850irq/126-lan22:21:242
15120991818,0cyclictest65850irq/126-lan22:15:522
15120991818,0cyclictest65850irq/126-lan19:36:252
15120991818,0cyclictest65850irq/126-lan00:17:002
15120991818,0cyclictest65850irq/126-lan00:10:142
15120991818,0cyclictest65850irq/126-lan00:06:222
15120991817,1cyclictest65850irq/126-lan23:50:172
15120991817,1cyclictest65850irq/126-lan23:36:192
15120991817,1cyclictest65850irq/126-lan22:53:042
15120991817,1cyclictest65850irq/126-lan21:40:152
15120991817,1cyclictest65850irq/126-lan21:35:152
15120991817,1cyclictest65850irq/126-lan21:31:292
15120991817,1cyclictest65850irq/126-lan21:15:162
15120991817,1cyclictest65850irq/126-lan20:40:242
15120991817,1cyclictest65850irq/126-lan19:30:002
15120991817,1cyclictest65850irq/126-lan00:25:422
15120991817,1cyclictest65850irq/126-lan00:02:102
15120991717,0cyclictest65850irq/126-lan23:10:132
15120991717,0cyclictest65850irq/126-lan22:30:142
15120991717,0cyclictest65850irq/126-lan00:37:002
15120991717,0cyclictest65850irq/126-lan00:20:102
15120991716,1cyclictest65850irq/126-lan23:55:132
15120991716,1cyclictest65850irq/126-lan23:45:182
15120991716,1cyclictest65850irq/126-lan23:32:142
15120991716,1cyclictest65850irq/126-lan23:28:222
15120991716,1cyclictest65850irq/126-lan23:20:152
15120991716,1cyclictest65850irq/126-lan22:40:102
15120991716,1cyclictest65850irq/126-lan22:39:542
15120991716,1cyclictest65850irq/126-lan22:00:132
15120991716,1cyclictest65850irq/126-lan21:58:392
15120991716,1cyclictest65850irq/126-lan21:53:262
15120991716,1cyclictest65850irq/126-lan21:45:172
15120991716,1cyclictest65850irq/126-lan21:10:212
15120991716,1cyclictest65850irq/126-lan20:45:192
15120991716,1cyclictest65850irq/126-lan20:35:162
15120991716,1cyclictest65850irq/126-lan20:30:162
15120991716,1cyclictest65850irq/126-lan20:00:162
15120991716,1cyclictest65850irq/126-lan19:45:252
15120991716,1cyclictest65850irq/126-lan19:20:142
15120991616,0cyclictest65850irq/126-lan22:08:052
15120991616,0cyclictest65850irq/126-lan21:25:232
15120991616,0cyclictest65850irq/126-lan21:22:012
15120991616,0cyclictest65850irq/126-lan20:50:162
15120991615,1cyclictest65850irq/126-lan23:05:172
15120991615,1cyclictest65850irq/126-lan23:00:182
15120991615,1cyclictest65850irq/126-lan22:45:002
15120991615,1cyclictest65850irq/126-lan22:25:372
15120991615,1cyclictest65850irq/126-lan20:25:202
15120991615,1cyclictest65850irq/126-lan19:50:172
15120991615,1cyclictest65850irq/126-lan19:15:182
15120991514,1cyclictest65850irq/126-lan21:00:222
15120991514,1cyclictest65850irq/126-lan00:30:152
15120991414,0cyclictest65850irq/126-lan21:08:322
15120991414,0cyclictest65850irq/126-lan19:40:252
15120991414,0cyclictest65850irq/126-lan19:10:192
15120991312,1cyclictest65850irq/126-lan20:05:162
15120991212,0cyclictest65850irq/126-lan20:10:212
15120991110,1cyclictest65850irq/126-lan20:20:232
15120991110,1cyclictest65850irq/126-lan19:55:112
1511599109,1cyclictest506-21avahi-daemon21:33:241
151249998,1cyclictest765-21snmpd21:27:083
151249998,1cyclictest763-21lldpd21:42:033
151249998,1cyclictest499-21systemd-resolve19:12:123
151209998,1cyclictest65850irq/126-lan20:55:182
151209998,1cyclictest65850irq/126-lan20:15:152
151209998,1cyclictest65850irq/126-lan19:25:142
151159998,1cyclictest765-21snmpd19:31:461
151159998,1cyclictest763-21lldpd20:10:001
151159998,1cyclictest763-21lldpd19:48:461
151159998,1cyclictest499-21systemd-resolve23:43:021
151119998,1cyclictest765-21snmpd23:46:040
151119998,1cyclictest765-21snmpd22:10:400
151119998,1cyclictest765-21snmpd20:04:530
151119998,1cyclictest763-21lldpd20:13:160
151119997,2cyclictest739-21ntpd23:53:500
151249988,0cyclictest765-21snmpd23:58:143
151249988,0cyclictest765-21snmpd22:45:583
151249988,0cyclictest765-21snmpd22:44:253
151249988,0cyclictest765-21snmpd22:35:193
151249988,0cyclictest763-21lldpd23:45:053
151249988,0cyclictest763-21lldpd23:29:163
151249988,0cyclictest763-21lldpd21:11:453
151249988,0cyclictest763-21lldpd00:22:303
151249987,1cyclictest765-21snmpd20:28:243
151249987,1cyclictest765-21snmpd20:20:233
151249987,1cyclictest765-21snmpd00:14:503
151249987,1cyclictest763-21lldpd22:11:063
151249987,1cyclictest763-21lldpd20:44:153
151249987,1cyclictest506-21avahi-daemon22:23:313
151249986,2cyclictest765-21snmpd22:16:063
151159988,0cyclictest763-21lldpd23:47:271
151159988,0cyclictest763-21lldpd21:42:451
151159988,0cyclictest763-21lldpd19:54:221
151159987,1cyclictest765-21snmpd23:25:481
151159987,1cyclictest765-21snmpd22:43:231
151159987,1cyclictest765-21snmpd19:17:481
151159987,1cyclictest763-21lldpd20:15:561
151159987,1cyclictest763-21lldpd19:38:101
151159987,1cyclictest506-21avahi-daemon22:55:331
151159987,1cyclictest506-21avahi-daemon20:20:211
151159986,2cyclictest765-21snmpd00:37:081
151159986,2cyclictest1066-21cat23:35:151
151159983,5cyclictest530-21NetworkManager00:19:531
151119988,0cyclictest765-21snmpd22:02:150
151119988,0cyclictest765-21snmpd21:09:550
151119988,0cyclictest765-21snmpd20:58:070
151119988,0cyclictest765-21snmpd00:24:380
151119988,0cyclictest765-21snmpd00:08:160
151119988,0cyclictest763-21lldpd20:07:320
151119988,0cyclictest763-21lldpd19:44:480
151119988,0cyclictest763-21lldpd19:34:320
151119987,1cyclictest765-21snmpd22:20:180
151119987,1cyclictest765-21snmpd21:00:550
151119987,1cyclictest763-21lldpd19:13:090
151119987,1cyclictest506-21avahi-daemon23:13:300
151119987,1cyclictest506-21avahi-daemon22:33:550
151119987,1cyclictest499-21systemd-resolve23:18:500
151119986,2cyclictest765-21snmpd22:40:490
151119986,2cyclictest765-21snmpd19:47:050
151119986,2cyclictest765-21snmpd00:19:090
151119985,3cyclictest765-21snmpd22:47:040
151249977,0cyclictest765-21snmpd23:31:213
151249977,0cyclictest765-21snmpd23:19:203
151249977,0cyclictest765-21snmpd23:00:353
151249977,0cyclictest765-21snmpd22:57:143
151249977,0cyclictest765-21snmpd22:06:213
151249977,0cyclictest765-21snmpd20:17:113
151249977,0cyclictest763-21lldpd23:43:283
151249977,0cyclictest763-21lldpd21:53:483
151249977,0cyclictest763-21lldpd19:47:383
151249976,1cyclictest506-21avahi-daemon21:46:153
151249975,2cyclictest765-21snmpd23:24:033
151249972,5cyclictest530-21NetworkManager00:07:213
151159977,0cyclictest765-21snmpd23:24:541
151159977,0cyclictest765-21snmpd22:26:201
151159977,0cyclictest763-21lldpd22:18:421
151159977,0cyclictest763-21lldpd22:12:521
151159977,0cyclictest763-21lldpd20:02:441
151159977,0cyclictest499-21systemd-resolve23:01:481
151159976,1cyclictest765-21snmpd22:30:131
151159976,1cyclictest765-21snmpd20:28:571
151159976,1cyclictest765-21snmpd19:20:521
151159976,1cyclictest763-21lldpd20:59:351
151159976,1cyclictest506-21avahi-daemon21:53:351
151159976,1cyclictest506-21avahi-daemon21:24:281
151159976,1cyclictest499-21systemd-resolve21:46:591
151159976,1cyclictest32055-21gltestperf19:55:171
151159975,2cyclictest765-21snmpd23:13:031
151159975,2cyclictest765-21snmpd21:14:521
151159975,2cyclictest765-21snmpd19:13:311
151159975,2cyclictest4767-21cat23:05:161
151159974,2cyclictest254-20systemd-journal00:22:031
151119977,0cyclictest765-21snmpd21:35:410
151119977,0cyclictest763-21lldpd23:58:320
151119977,0cyclictest763-21lldpd22:52:050
151119977,0cyclictest763-21lldpd20:48:510
151119977,0cyclictest763-21lldpd19:25:590
151119977,0cyclictest763-21lldpd00:01:250
151119976,1cyclictest765-21snmpd19:20:010
151119976,1cyclictest739-21ntpd00:29:410
151119976,1cyclictest499-21systemd-resolve23:35:540
151119976,1cyclictest499-21systemd-resolve23:27:260
151119976,1cyclictest2010-21gltestperf00:10:150
151119975,2cyclictest765-21snmpd21:51:410
151119975,2cyclictest765-21snmpd21:21:190
151119975,2cyclictest765-21snmpd20:54:120
151119974,2cyclictest254-20systemd-journal22:05:510
151249966,0cyclictest765-21snmpd21:30:473
151249966,0cyclictest763-21lldpd23:50:133
151249966,0cyclictest763-21lldpd21:38:523
151249965,1cyclictest765-21snmpd19:53:023
151249965,1cyclictest765-21snmpd19:19:523
151249965,1cyclictest506-21avahi-daemon21:20:443
151249965,1cyclictest22191-21idleruntime-cro19:30:003
151249964,2cyclictest765-21snmpd23:36:213
151249964,2cyclictest765-21snmpd20:55:573
151249964,2cyclictest765-21snmpd20:09:323
151249964,2cyclictest765-21snmpd20:03:173
151249964,2cyclictest765-21snmpd19:30:583
151249963,2cyclictest26009-21ssh00:38:503
151249963,2cyclictest10834-21ssh23:11:273
151249962,3cyclictest14921-21dpkg00:25:013
151249961,5cyclictest530-21NetworkManager00:04:213
151159966,0cyclictest765-21snmpd20:48:301
151159966,0cyclictest765-21snmpd20:07:171
151159966,0cyclictest763-21lldpd23:18:151
151159966,0cyclictest763-21lldpd22:07:541
151159966,0cyclictest763-21lldpd00:25:381
151159965,1cyclictest765-21snmpd21:15:581
151159965,1cyclictest506-21avahi-daemon00:33:041
151159965,1cyclictest499-21systemd-resolve22:47:421
151159964,2cyclictest765-21snmpd20:37:031
151159964,2cyclictest765-21snmpd19:26:281
151159964,2cyclictest530-21NetworkManager23:50:041
151159964,2cyclictest254-20systemd-journal22:21:491
151159963,2cyclictest9722-21ssh22:02:121
151159963,2cyclictest31541-21ssh23:33:241
151159962,3cyclictest23280-21ssh22:50:431
151119966,0cyclictest765-21snmpd22:36:010
151119966,0cyclictest765-21snmpd20:36:270
151119966,0cyclictest765-21snmpd19:55:050
151119966,0cyclictest763-21lldpd23:21:130
151119966,0cyclictest763-21lldpd21:25:330
151119966,0cyclictest763-21lldpd21:14:550
151119966,0cyclictest763-21lldpd20:22:360
151119966,0cyclictest763-21lldpd19:50:160
151119966,0cyclictest763-21lldpd19:15:430
151119966,0cyclictest506-21avahi-daemon19:38:250
151119965,1cyclictest765-21snmpd23:05:440
151119965,1cyclictest765-21snmpd21:31:590
151119964,2cyclictest765-21snmpd23:42:000
151119964,2cyclictest765-21snmpd00:31:150
151119964,2cyclictest15348-21cat20:40:210
151119963,3cyclictest530-21NetworkManager23:32:520
151119963,3cyclictest530-21NetworkManager21:18:180
151119963,3cyclictest24205-21ssh22:17:440
151119962,3cyclictest27039-21memory22:55:160
151119962,3cyclictest26890-21dpkg00:40:000
151119962,3cyclictest21925-21ssh21:40:270
151249955,0cyclictest763-21lldpd23:07:173
151249955,0cyclictest763-21lldpd20:50:193
151249955,0cyclictest13435-21fschecks_count20:35:133
151249954,1cyclictest765-21snmpd19:35:523
151249954,1cyclictest499-21systemd-resolve19:24:403
151249954,1cyclictest3297-21cpuspeed_turbos22:30:143
151249954,1cyclictest31004-21cpuspeed_turbos22:25:143
151249954,1cyclictest22030-21cpuspeed_turbos22:50:143
151249953,2cyclictest765-21snmpd21:09:013
151249953,2cyclictest765-21snmpd19:56:233
151249953,2cyclictest530-21NetworkManager21:17:583
151249953,2cyclictest30078-21kworker/3:0-mm_percpu_wq20:31:473
151249952,2cyclictest20610-21ssh00:31:043
151249952,2cyclictest10111-21ssh22:02:483
151249950,5cyclictest3316-21ntpq21:55:173
151159955,0cyclictest506-21avahi-daemon21:06:341
151159955,0cyclictest506-21avahi-daemon19:43:351
151159955,0cyclictest29445-21cpuspeed_turbos00:05:131
151159954,1cyclictest15105-21cyclictest00:13:131
151159953,2cyclictest765-21snmpd21:03:311
151159953,2cyclictest508-21dbus-daemon00:00:001
151159953,2cyclictest16561-21cat21:35:171
151159952,3cyclictest530-21NetworkManager22:36:511
151159952,3cyclictest530-21NetworkManager21:26:261
151159952,2cyclictest554-21rs:main1
151159952,2cyclictest3953-21ssh21:55:371
151159952,2cyclictest20180-21sh23:55:151
151119954,1cyclictest765-21snmpd21:55:310
151119954,1cyclictest765-21snmpd21:46:230
151119953,2cyclictest765-21snmpd22:26:430
151119951,3cyclictest3239-21ssh23:04:380
151249942,2cyclictest765-21snmpd20:13:533
151249942,2cyclictest765-21snmpd19:40:463
151249940,4cyclictest22376-21ntpq21:00:223
151249940,4cyclictest17330-21ntpq20:45:223
151249940,3cyclictest7444-21ntpq00:15:173
151159941,2cyclictest554-21rs:main1
151159941,2cyclictest12371-21processes20:30:191
151119941,2cyclictest9796-21apt-key20:25:000
151119940,4cyclictest12275-21ntpq20:30:180
151119940,3cyclictest6684-21ntpq20:15:200
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional