You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-26 - 09:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Thu Mar 26, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1014992018,2cyclictest743-21snmpd00:39:431
1023991918,1cyclictest65850irq/126-lan19:55:153
1023991818,0cyclictest65850irq/126-lan00:00:103
1023991817,1cyclictest65850irq/126-lan23:55:203
1023991817,1cyclictest65850irq/126-lan22:15:183
1023991817,1cyclictest65850irq/126-lan21:45:113
1023991817,1cyclictest65850irq/126-lan20:33:073
1023991817,1cyclictest65850irq/126-lan00:05:163
1023991717,0cyclictest65850irq/126-lan23:10:123
1023991717,0cyclictest65850irq/126-lan22:10:183
1023991717,0cyclictest65850irq/126-lan21:55:163
1023991717,0cyclictest65850irq/126-lan20:20:113
1023991717,0cyclictest65850irq/126-lan19:35:223
1023991716,1cyclictest65850irq/126-lan23:15:173
1023991716,1cyclictest65850irq/126-lan21:40:143
1023991616,0cyclictest65850irq/126-lan22:20:113
1023991616,0cyclictest65850irq/126-lan20:40:173
1023991616,0cyclictest65850irq/126-lan20:25:143
1023991615,1cyclictest65850irq/126-lan23:20:163
1023991615,1cyclictest65850irq/126-lan23:05:173
1023991615,1cyclictest65850irq/126-lan20:40:003
1023991615,1cyclictest65850irq/126-lan20:15:173
1023991615,1cyclictest65850irq/126-lan19:45:143
1023991615,1cyclictest65850irq/126-lan00:10:133
1023991515,0cyclictest65850irq/126-lan23:45:273
1023991515,0cyclictest65850irq/126-lan23:35:213
1023991515,0cyclictest65850irq/126-lan22:31:283
1023991515,0cyclictest65850irq/126-lan21:25:163
1023991515,0cyclictest65850irq/126-lan19:20:153
1023991514,1cyclictest65850irq/126-lan22:40:193
1023991514,1cyclictest65850irq/126-lan21:10:183
1023991514,1cyclictest65850irq/126-lan21:00:163
1023991514,1cyclictest65850irq/126-lan20:50:013
1023991514,1cyclictest65850irq/126-lan19:50:113
1023991514,1cyclictest65850irq/126-lan19:15:113
1023991414,0cyclictest65850irq/126-lan22:50:203
1023991414,0cyclictest65850irq/126-lan00:30:213
1023991414,0cyclictest65850irq/126-lan00:20:193
1023991413,1cyclictest65850irq/126-lan21:05:113
1023991413,1cyclictest65850irq/126-lan19:40:153
1023991413,1cyclictest65850irq/126-lan19:10:133
1023991313,0cyclictest65850irq/126-lan23:33:283
1023991313,0cyclictest65850irq/126-lan22:45:133
1023991313,0cyclictest65850irq/126-lan22:25:133
1023991313,0cyclictest65850irq/126-lan21:36:173
1023991313,0cyclictest65850irq/126-lan21:20:113
1023991313,0cyclictest65850irq/126-lan20:55:163
1023991313,0cyclictest65850irq/126-lan20:05:173
1023991313,0cyclictest65850irq/126-lan00:35:173
1023991313,0cyclictest65850irq/126-lan00:25:123
1023991312,1cyclictest65850irq/126-lan23:40:153
1023991312,1cyclictest65850irq/126-lan23:25:203
1023991312,1cyclictest65850irq/126-lan20:00:173
1023991312,1cyclictest65850irq/126-lan19:25:163
1023991211,1cyclictest65850irq/126-lan22:55:123
1023991211,1cyclictest65850irq/126-lan22:00:163
1023991211,1cyclictest65850irq/126-lan21:31:273
1023991211,1cyclictest65850irq/126-lan20:10:203
1023991211,1cyclictest65850irq/126-lan19:30:153
1023991111,0cyclictest65850irq/126-lan22:05:163
1023991110,1cyclictest65850irq/126-lan23:00:183
102399109,1cyclictest65850irq/126-lan23:50:123
1023991010,0cyclictest65850irq/126-lan21:18:283
1023991010,0cyclictest65850irq/126-lan20:52:563
10239998,1cyclictest65850irq/126-lan22:35:123
10189998,1cyclictest741-21lldpd21:54:592
10189998,1cyclictest741-21lldpd00:37:402
10149998,1cyclictest743-21snmpd23:42:301
10149998,1cyclictest743-21snmpd22:14:081
10089998,1cyclictest743-21snmpd20:33:530
10239988,0cyclictest741-21lldpd21:51:413
10239988,0cyclictest65850irq/126-lan00:19:363
10189988,0cyclictest743-21snmpd21:39:202
10189988,0cyclictest743-21snmpd19:55:192
10189988,0cyclictest741-21lldpd23:34:432
10189988,0cyclictest741-21lldpd20:56:322
10189988,0cyclictest741-21lldpd19:41:512
10189988,0cyclictest741-21lldpd00:26:232
10189986,2cyclictest743-21snmpd22:52:462
10189986,2cyclictest743-21snmpd22:40:452
10189986,2cyclictest743-21snmpd22:17:062
10189986,2cyclictest743-21snmpd21:04:422
10189986,2cyclictest743-21snmpd20:08:242
10189986,2cyclictest743-21snmpd20:01:492
10189986,2cyclictest743-21snmpd19:29:452
10189986,2cyclictest717-21ntpd23:41:342
10189986,2cyclictest717-21ntpd22:36:292
10189986,2cyclictest717-21ntpd22:29:282
10189986,2cyclictest30235-21cat00:15:142
10149988,0cyclictest743-21snmpd22:58:101
10149988,0cyclictest743-21snmpd20:31:231
10149988,0cyclictest741-21lldpd23:34:151
10149988,0cyclictest741-21lldpd22:01:571
10149988,0cyclictest741-21lldpd19:43:191
10149987,1cyclictest743-21snmpd22:37:431
10149987,1cyclictest743-21snmpd20:48:121
10149987,1cyclictest743-21snmpd00:00:101
10149987,1cyclictest11648-21ntp_kernel_err20:50:151
10149986,2cyclictest743-21snmpd23:23:321
10149986,2cyclictest743-21snmpd21:53:591
10149986,2cyclictest743-21snmpd21:11:151
10149986,2cyclictest4462-21cat20:35:131
10149986,2cyclictest21721-21cat23:55:131
10149985,3cyclictest743-21snmpd19:46:571
10089988,0cyclictest522-21avahi-daemon20:39:430
10089987,1cyclictest743-21snmpd23:40:240
10089987,1cyclictest743-21snmpd22:25:000
10089987,1cyclictest743-21snmpd20:27:290
10089987,1cyclictest741-21lldpd23:10:190
10089987,1cyclictest741-21lldpd21:29:430
10089987,1cyclictest741-21lldpd19:10:360
10089986,2cyclictest743-21snmpd23:00:090
10089986,2cyclictest743-21snmpd21:05:480
10189977,0cyclictest743-21snmpd23:55:152
10189977,0cyclictest743-21snmpd23:52:032
10189977,0cyclictest743-21snmpd19:47:462
10189977,0cyclictest743-21snmpd00:08:312
10189977,0cyclictest741-21lldpd21:42:272
10189977,0cyclictest741-21lldpd20:16:012
10189977,0cyclictest741-21lldpd19:37:432
10189976,1cyclictest743-21snmpd20:28:292
10189976,1cyclictest743-21snmpd19:21:052
10189976,1cyclictest717-21ntpd21:47:312
10189976,1cyclictest522-21avahi-daemon21:50:032
10189976,1cyclictest506-21systemd-resolve22:14:272
10189976,1cyclictest17229-21/usr/sbin/munin23:45:172
10189975,2cyclictest743-21snmpd23:11:502
10189975,2cyclictest743-21snmpd23:03:532
10189975,2cyclictest743-21snmpd00:13:102
10189975,2cyclictest717-21ntpd22:46:342
10189975,2cyclictest717-21ntpd20:40:282
10189975,2cyclictest717-21ntpd20:10:272
10189975,2cyclictest717-21ntpd19:10:322
10189972,5cyclictest557-21NetworkManager20:46:222
10149977,0cyclictest741-21lldpd23:18:331
10149977,0cyclictest741-21lldpd22:44:491
10149977,0cyclictest741-21lldpd21:27:011
10149977,0cyclictest741-21lldpd19:59:031
10149977,0cyclictest741-21lldpd00:20:341
10149977,0cyclictest741-21lldpd00:06:081
10149976,1cyclictest743-21snmpd19:16:551
10149976,1cyclictest506-21systemd-resolve23:46:081
10149976,1cyclictest28452-21needreboot00:10:151
10149976,1cyclictest27849-21cat22:50:131
10149975,2cyclictest743-21snmpd23:10:561
10149975,2cyclictest743-21snmpd22:26:261
10149975,2cyclictest743-21snmpd21:45:381
10149975,2cyclictest743-21snmpd20:44:301
10149975,2cyclictest743-21snmpd20:23:401
10149975,2cyclictest743-21snmpd19:51:211
10149975,2cyclictest17428-21cat21:05:141
10089977,0cyclictest743-21snmpd23:15:580
10089977,0cyclictest743-21snmpd21:16:280
10089977,0cyclictest743-21snmpd20:46:030
10089977,0cyclictest741-21lldpd21:39:380
10089977,0cyclictest741-21lldpd21:05:000
10089977,0cyclictest741-21lldpd19:47:430
10089976,1cyclictest743-21snmpd23:33:080
10089976,1cyclictest743-21snmpd20:13:280
10089976,1cyclictest522-21avahi-daemon21:34:410
10089976,1cyclictest522-21avahi-daemon19:50:330
10089975,2cyclictest743-21snmpd23:20:410
10089975,2cyclictest743-21snmpd22:03:080
10089975,2cyclictest743-21snmpd21:53:560
10089975,2cyclictest743-21snmpd21:24:220
10089975,2cyclictest743-21snmpd20:06:510
10089975,2cyclictest743-21snmpd19:34:270
10089975,2cyclictest743-21snmpd00:27:560
10089975,2cyclictest743-21snmpd00:10:490
10089974,3cyclictest743-21snmpd22:51:400
10089974,3cyclictest5930-21apt-get00:35:110
10189966,0cyclictest743-21snmpd21:27:192
10189965,1cyclictest9389-21cpuspeed_turbos19:30:112
10189965,1cyclictest743-21snmpd23:24:082
10189965,1cyclictest743-21snmpd22:31:212
10189965,1cyclictest743-21snmpd22:05:052
10189963,3cyclictest23042-21apt-get21:20:092
10189963,2cyclictest717-21ntpd21:15:172
10189962,4cyclictest557-21NetworkManager22:20:102
10189962,3cyclictest4607-21users19:15:212
10189961,4cyclictest3915-21cat20:35:012
10149966,0cyclictest743-21snmpd21:59:221
10149966,0cyclictest741-21lldpd22:49:591
10149966,0cyclictest741-21lldpd20:10:091
10149966,0cyclictest522-21avahi-daemon22:06:201
10149965,1cyclictest743-21snmpd19:33:211
10149965,1cyclictest575-21rs:main1
10149965,1cyclictest506-21systemd-resolve20:17:061
10149964,2cyclictest743-21snmpd23:37:331
10149962,2cyclictest22885-21cat21:20:011
10149961,4cyclictest7216-21cat19:25:001
10089966,0cyclictest743-21snmpd23:35:030
10089966,0cyclictest743-21snmpd19:55:250
10089966,0cyclictest743-21snmpd19:19:510
10089966,0cyclictest741-21lldpd22:20:090
10089965,1cyclictest741-21lldpd22:05:370
10089964,2cyclictest743-21snmpd19:29:090
10089964,2cyclictest743-21snmpd00:33:500
10089964,2cyclictest244-20systemd-journal22:35:000
10089963,3cyclictest557-21NetworkManager20:02:360
10089962,3cyclictest29808-21apt00:15:120
10189955,0cyclictest743-21snmpd23:06:322
10189955,0cyclictest741-21lldpd21:34:062
10189954,1cyclictest743-21snmpd23:19:412
10189953,2cyclictest743-21snmpd21:14:372
10189953,2cyclictest743-21snmpd19:54:152
10189953,2cyclictest11372-21cat20:50:132
10189952,3cyclictest743-21snmpd22:03:412
10189952,3cyclictest557-21NetworkManager23:26:092
10189952,3cyclictest557-21NetworkManager20:36:272
10189952,2cyclictest30275-21ld22:55:162
10189950,5cyclictest557-21NetworkManager20:22:312
10189950,4cyclictest24132-21ntpq00:00:142
10149955,0cyclictest741-21lldpd23:27:241
10149955,0cyclictest741-21lldpd22:33:071
10149955,0cyclictest522-21avahi-daemon21:31:451
10149955,0cyclictest506-21systemd-resolve22:18:301
10149954,1cyclictest31766-21gltestperf23:00:121
10149954,1cyclictest19712-21cat23:50:141
10149953,2cyclictest22710-21cat20:00:151
10149953,2cyclictest15401-21cat21:00:131
10149952,2cyclictest2353-21ld00:25:171
10149952,2cyclictest23179-21grep21:20:111
10149952,2cyclictest11869-21sed19:35:151
10149950,4cyclictest8136-21ntp_states19:25:161
10149950,4cyclictest31412-21fw_forwarded_lo21:40:121
10089955,0cyclictest2845-21latency_hist23:10:000
10089955,0cyclictest0-21swapper/020:20:110
10089954,1cyclictest0-21swapper/019:35:160
10089953,2cyclictest743-21snmpd23:29:390
10089953,2cyclictest743-21snmpd22:18:270
10089952,3cyclictest557-21NetworkManager23:50:510
10089952,3cyclictest31670-21sshd21:40:130
10089952,2cyclictest6511-21cat19:20:200
10089952,2cyclictest5077-21gltestperf21:55:130
10089952,2cyclictest30742-21grep22:55:200
10089952,2cyclictest28691-21expr20:15:150
10089952,2cyclictest26149-21ld00:05:150
10089952,2cyclictest24597-21timerwakeupswit22:40:250
10089952,2cyclictest20479-21sed22:30:170
10089952,2cyclictest19813-21cat21:10:150
10089952,2cyclictest1629-21grep21:45:170
10089952,2cyclictest14112-21ld19:40:160
10089951,4cyclictest717-21ntpd20:55:110
10089951,3cyclictest6477-21cat20:40:130
10089951,3cyclictest21569-21fw_forwarded_lo23:55:120
10089951,3cyclictest10849-21apt-get22:10:110
10189942,2cyclictest743-21snmpd00:20:042
10189942,2cyclictest14604-21sshd23:35:402
10189940,3cyclictest4267-21ntpq00:30:172
10189940,3cyclictest17275-21fw_forwarded_lo21:05:122
10149944,0cyclictest0-21swapper/122:20:121
10149943,1cyclictest24293-21apt-get20:05:101
10149942,2cyclictest1650-21cat19:10:141
10149940,3cyclictest818-21ntp_states20:25:181
10149940,3cyclictest557-21NetworkManager00:30:121
10149940,3cyclictest29977-21diskstats00:15:131
10149940,3cyclictest1813-21ntpq23:05:161
10149940,3cyclictest13229-21fw_conntrack20:55:141
10089944,0cyclictest0-21swapper/000:20:160
10089942,2cyclictest26251-21ntpq22:45:170
10089941,2cyclictest10672-21cat20:50:010
10089940,3cyclictest18036-21ntpq23:45:170
10089940,2cyclictest23335-21apt-get00:00:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional