You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-03 - 07:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot6s.osadl.org (updated Wed Dec 03, 2025 00:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4435991918,1cyclictest66850irq/125-lan23:57:211
4435991918,1cyclictest66850irq/125-lan23:12:501
4435991918,1cyclictest66850irq/125-lan22:20:451
4435991918,1cyclictest66850irq/125-lan21:59:441
4435991918,1cyclictest66850irq/125-lan21:35:141
4435991918,1cyclictest66850irq/125-lan21:25:221
4435991918,1cyclictest66850irq/125-lan00:30:201
4435991918,1cyclictest66850irq/125-lan00:12:081
4435991818,0cyclictest66850irq/125-lan23:50:161
4435991818,0cyclictest66850irq/125-lan23:27:111
4435991818,0cyclictest66850irq/125-lan22:44:581
4435991818,0cyclictest66850irq/125-lan22:39:081
4435991818,0cyclictest66850irq/125-lan00:21:361
4435991817,1cyclictest66850irq/125-lan23:20:131
4435991817,1cyclictest66850irq/125-lan23:00:331
4435991817,1cyclictest66850irq/125-lan22:33:261
4435991817,1cyclictest66850irq/125-lan22:12:501
4435991817,1cyclictest66850irq/125-lan22:00:381
4435991817,1cyclictest66850irq/125-lan21:55:011
4435991817,1cyclictest66850irq/125-lan21:30:111
4435991817,1cyclictest66850irq/125-lan21:23:031
4435991817,1cyclictest66850irq/125-lan19:53:181
4435991817,1cyclictest66850irq/125-lan00:05:331
4435991717,0cyclictest66850irq/125-lan23:30:191
4435991717,0cyclictest66850irq/125-lan22:16:571
4435991717,0cyclictest66850irq/125-lan21:40:141
4435991717,0cyclictest66850irq/125-lan21:11:481
4435991717,0cyclictest66850irq/125-lan19:49:131
4435991717,0cyclictest66850irq/125-lan00:15:291
4435991716,1cyclictest66850irq/125-lan23:45:431
4435991716,1cyclictest66850irq/125-lan23:40:141
4435991716,1cyclictest66850irq/125-lan23:35:211
4435991716,1cyclictest66850irq/125-lan23:15:141
4435991716,1cyclictest66850irq/125-lan23:06:131
4435991716,1cyclictest66850irq/125-lan22:57:381
4435991716,1cyclictest66850irq/125-lan22:50:141
4435991716,1cyclictest66850irq/125-lan22:49:101
4435991716,1cyclictest66850irq/125-lan22:05:211
4435991716,1cyclictest66850irq/125-lan21:45:171
4435991716,1cyclictest66850irq/125-lan21:05:171
4435991716,1cyclictest66850irq/125-lan00:35:181
4435991716,1cyclictest66850irq/125-lan00:26:471
4435991716,1cyclictest66850irq/125-lan00:02:291
4435991616,0cyclictest66850irq/125-lan22:25:191
4435991616,0cyclictest66850irq/125-lan20:18:171
4435991616,0cyclictest66850irq/125-lan19:30:171
4435991615,1cyclictest66850irq/125-lan21:16:001
4435991615,1cyclictest66850irq/125-lan21:15:591
4435991615,1cyclictest66850irq/125-lan20:40:171
4435991615,1cyclictest66850irq/125-lan20:05:121
4435991615,1cyclictest66850irq/125-lan19:40:141
4435991615,1cyclictest66850irq/125-lan19:15:141
4435991615,1cyclictest66850irq/125-lan19:12:191
4435991515,0cyclictest66850irq/125-lan21:00:461
4435991515,0cyclictest66850irq/125-lan19:56:471
4435991515,0cyclictest66850irq/125-lan19:25:161
4435991514,1cyclictest66850irq/125-lan20:45:231
4435991514,1cyclictest66850irq/125-lan20:20:161
4435991514,1cyclictest66850irq/125-lan20:10:181
4435991414,0cyclictest66850irq/125-lan20:00:151
4435991414,0cyclictest66850irq/125-lan19:35:161
4435991414,0cyclictest66850irq/125-lan19:20:231
4435991413,1cyclictest66850irq/125-lan20:25:201
4435991313,0cyclictest66850irq/125-lan20:40:001
4435991212,0cyclictest66850irq/125-lan20:55:201
4431991210,2cyclictest749-21ntpd21:46:060
444299108,2cyclictest6078-21grep21:25:143
443599109,1cyclictest66850irq/125-lan20:30:111
44429998,1cyclictest771-21snmpd21:34:453
44429998,1cyclictest524-21avahi-daemon21:55:403
44429996,3cyclictest771-21snmpd20:57:083
44409999,0cyclictest524-21avahi-daemon23:49:172
44409998,1cyclictest769-21lldpd22:09:402
44359998,1cyclictest66850irq/125-lan20:50:221
44319998,1cyclictest771-21snmpd20:36:570
44319998,1cyclictest769-21lldpd23:09:270
44319998,1cyclictest769-21lldpd21:37:360
44429988,0cyclictest771-21snmpd23:18:003
44429988,0cyclictest771-21snmpd22:58:563
44429988,0cyclictest771-21snmpd22:36:173
44429988,0cyclictest771-21snmpd22:29:283
44429988,0cyclictest771-21snmpd21:37:273
44429988,0cyclictest771-21snmpd20:26:463
44429988,0cyclictest771-21snmpd19:37:173
44429988,0cyclictest769-21lldpd23:26:333
44429988,0cyclictest769-21lldpd23:20:453
44429988,0cyclictest769-21lldpd22:40:263
44429988,0cyclictest769-21lldpd21:49:083
44429988,0cyclictest769-21lldpd21:09:333
44429987,1cyclictest771-21snmpd21:52:093
44429987,1cyclictest771-21snmpd21:02:193
44429987,1cyclictest771-21snmpd20:33:423
44429987,1cyclictest771-21snmpd19:49:533
44429987,1cyclictest771-21snmpd19:42:333
44429987,1cyclictest771-21snmpd19:14:023
44429987,1cyclictest771-21snmpd00:33:183
44429987,1cyclictest769-21lldpd23:11:583
44429987,1cyclictest590-21gmain21:42:103
44429987,1cyclictest524-21avahi-daemon22:33:423
44429987,1cyclictest524-21avahi-daemon00:37:003
44429986,2cyclictest771-21snmpd22:49:483
44429986,2cyclictest771-21snmpd22:23:383
44429986,2cyclictest771-21snmpd22:05:493
44429986,2cyclictest771-21snmpd19:19:283
44429986,2cyclictest12300-21cat20:45:163
44429985,3cyclictest771-21snmpd22:51:093
44409988,0cyclictest771-21snmpd22:27:132
44409988,0cyclictest771-21snmpd21:29:032
44409988,0cyclictest771-21snmpd20:12:332
44409988,0cyclictest769-21lldpd23:31:502
44409988,0cyclictest769-21lldpd22:18:402
44409988,0cyclictest769-21lldpd21:33:592
44409988,0cyclictest769-21lldpd20:44:212
44409987,1cyclictest9835-21fschecks_time23:00:152
44409987,1cyclictest9820-21sh00:35:152
44409987,1cyclictest769-21lldpd21:54:582
44409987,1cyclictest769-21lldpd21:06:522
44409987,1cyclictest524-21avahi-daemon22:37:462
44409987,1cyclictest524-21avahi-daemon21:17:462
44409987,1cyclictest524-21avahi-daemon21:17:462
44409986,2cyclictest771-21snmpd22:58:142
44319988,0cyclictest771-21snmpd21:50:120
44319988,0cyclictest771-21snmpd20:07:560
44319988,0cyclictest771-21snmpd19:51:320
44319988,0cyclictest771-21snmpd00:30:590
44319988,0cyclictest769-21lldpd23:29:280
44319988,0cyclictest769-21lldpd00:27:320
44319987,1cyclictest771-21snmpd23:58:140
44319987,1cyclictest769-21lldpd20:47:010
44319987,1cyclictest524-21avahi-daemon21:21:350
44319986,2cyclictest771-21snmpd23:49:550
44319986,2cyclictest771-21snmpd21:58:550
44319986,2cyclictest771-21snmpd21:09:340
44319986,2cyclictest771-21snmpd19:46:330
44319986,2cyclictest771-21snmpd00:22:150
44319986,2cyclictest10012-21cat23:00:150
44319985,3cyclictest771-21snmpd19:41:480
44429977,0cyclictest771-21snmpd23:37:523
44429977,0cyclictest771-21snmpd20:44:073
44429977,0cyclictest769-21lldpd23:30:403
44429977,0cyclictest769-21lldpd22:13:113
44429977,0cyclictest769-21lldpd21:13:043
44429977,0cyclictest769-21lldpd20:38:273
44429977,0cyclictest769-21lldpd00:11:593
44429976,1cyclictest771-21snmpd20:10:303
44429976,1cyclictest524-21avahi-daemon21:19:153
44429976,1cyclictest524-21avahi-daemon21:19:143
44429976,1cyclictest15666-21pmu-power23:05:203
44429975,2cyclictest771-21snmpd23:52:323
44429975,2cyclictest771-21snmpd21:24:513
44429975,2cyclictest771-21snmpd20:53:023
44429975,2cyclictest771-21snmpd19:26:113
44429975,2cyclictest23198-21cat19:55:153
44429974,3cyclictest771-21snmpd20:15:293
44429973,3cyclictest517-21systemd-resolve00:22:453
44409977,0cyclictest771-21snmpd21:38:482
44409977,0cyclictest769-21lldpd23:41:172
44409977,0cyclictest769-21lldpd20:48:482
44409976,1cyclictest771-21snmpd20:03:322
44409976,1cyclictest769-21lldpd00:08:442
44409976,1cyclictest524-21avahi-daemon22:02:102
44409976,1cyclictest21188-21cat19:50:162
44409975,2cyclictest771-21snmpd23:55:312
44409975,2cyclictest771-21snmpd20:56:472
44409975,2cyclictest771-21snmpd19:49:442
44409975,2cyclictest22861-21cat00:15:152
44409974,3cyclictest771-21snmpd22:44:132
44409974,3cyclictest771-21snmpd00:11:012
44409974,2cyclictest255-20systemd-journal23:37:172
44319977,0cyclictest771-21snmpd22:13:370
44319977,0cyclictest771-21snmpd21:41:180
44319977,0cyclictest771-21snmpd19:15:220
44319977,0cyclictest769-21lldpd23:54:120
44319977,0cyclictest769-21lldpd22:56:270
44319977,0cyclictest769-21lldpd21:25:560
44319977,0cyclictest769-21lldpd19:58:100
44319977,0cyclictest769-21lldpd19:27:000
44319977,0cyclictest26975-21cat22:45:130
44319976,1cyclictest771-21snmpd23:38:010
44319976,1cyclictest771-21snmpd20:50:220
44319976,1cyclictest771-21snmpd19:37:550
44319976,1cyclictest524-21avahi-daemon21:33:320
44319976,1cyclictest524-21avahi-daemon00:17:120
44319975,2cyclictest771-21snmpd22:04:570
44319975,2cyclictest771-21snmpd21:13:080
44319975,2cyclictest771-21snmpd19:10:350
44319975,2cyclictest749-21ntpd23:12:040
44319973,3cyclictest255-20systemd-journal23:32:340
44319973,0cyclictest0-21swapper/022:05:540
44429966,0cyclictest771-21snmpd00:17:363
44429966,0cyclictest769-21lldpd23:40:053
44429966,0cyclictest769-21lldpd19:51:303
44429965,1cyclictest584-21in:imuxsock20:01:573
44429965,1cyclictest524-21avahi-daemon23:57:243
44429965,1cyclictest517-21systemd-resolve00:25:223
44429964,2cyclictest771-21snmpd19:21:263
44429964,1cyclictest586-21rs:main3
44429963,2cyclictest14721-21ssh00:06:113
44429962,3cyclictest12816-21sed22:00:213
44409966,0cyclictest771-21snmpd22:48:532
44409966,0cyclictest771-21snmpd20:34:572
44409966,0cyclictest771-21snmpd00:31:482
44409966,0cyclictest769-21lldpd21:40:442
44409966,0cyclictest769-21lldpd20:19:482
44409966,0cyclictest769-21lldpd19:34:032
44409966,0cyclictest524-21avahi-daemon20:50:412
44409965,1cyclictest8898-21fschecks_time19:20:152
44409965,1cyclictest771-21snmpd21:11:472
44409965,1cyclictest769-21lldpd23:24:412
44409965,1cyclictest23650-21nvmesmart_nvme019:55:192
44409964,2cyclictest771-21snmpd22:13:482
44409964,2cyclictest771-21snmpd20:35:062
44409964,2cyclictest771-21snmpd00:24:122
44409963,3cyclictest15013-21fw_packets23:05:152
44409963,2cyclictest586-21rs:main2
44409963,2cyclictest255-20systemd-journal19:41:552
44409963,2cyclictest1268-21ssh22:51:112
44409962,3cyclictest10327-21ssh00:01:242
44319966,0cyclictest771-21snmpd20:26:010
44319966,0cyclictest771-21snmpd20:22:000
44319966,0cyclictest771-21snmpd00:38:420
44319966,0cyclictest769-21lldpd22:21:150
44319966,0cyclictest769-21lldpd19:21:470
44319965,1cyclictest771-21snmpd20:01:330
44319965,1cyclictest769-21lldpd00:14:160
44319964,2cyclictest6172-21cat22:25:140
44319964,2cyclictest507-21grep22:50:210
44319963,3cyclictest8213-21apt-get00:00:110
44319963,2cyclictest29554-21sshd20:10:180
44319962,3cyclictest32618-21users20:15:230
44319962,3cyclictest31324-21ntp_states23:20:170
44319962,3cyclictest27365-21df21:15:120
44319962,3cyclictest27365-21df21:15:110
44319962,3cyclictest15943-21ssh22:35:010
44429954,1cyclictest979-21cpuspeed_turbos20:20:143
44429953,2cyclictest0-21swapper/319:30:123
44429952,2cyclictest9026-21ld00:00:173
44429952,2cyclictest10612-21uname23:00:203
44429951,2cyclictest25760-21head23:45:163
44409955,0cyclictest771-21snmpd21:02:402
44409955,0cyclictest771-21snmpd00:26:322
44409954,1cyclictest771-21snmpd19:27:412
44409954,1cyclictest506-21cpuspeed_turbos22:20:132
44409953,2cyclictest771-21snmpd23:54:172
44409953,2cyclictest771-21snmpd20:29:582
44409952,2cyclictest8230-21rm21:56:082
44409952,2cyclictest5414-21ssh23:26:122
44409952,2cyclictest31714-21ssh21:48:542
44409952,2cyclictest29450-21ssh23:19:132
44409952,2cyclictest2587-21seq20:24:172
44409952,2cyclictest2505-21rm21:21:072
44409951,3cyclictest5073-21irqstats19:10:162
44409950,4cyclictest7370-21ntpq19:15:172
44409950,4cyclictest11817-21ntpq22:30:172
44319954,1cyclictest524-21avahi-daemon19:30:190
44319953,2cyclictest749-21ntpd21:00:400
44319952,3cyclictest255-20systemd-journal00:06:410
44319952,3cyclictest21649-21perl22:40:140
44319952,3cyclictest19665-21uniq23:40:130
44319952,2cyclictest5810-21ld20:30:180
44319952,2cyclictest30290-21ssh22:17:010
44319952,2cyclictest26346-21threads23:15:190
44429941,3cyclictest26984-21diskstats20:05:143
44409941,2cyclictest27100-21fschecks_time20:05:132
44409941,2cyclictest15006-21grep19:35:152
44319942,2cyclictest0-21swapper/020:40:060
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional