You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-06 - 12:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack8slot6s.osadl.org (updated Sat Dec 06, 2025 00:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22210991919,0cyclictest66850irq/125-lan22:01:201
22210991918,1cyclictest66850irq/125-lan23:55:191
22210991918,1cyclictest66850irq/125-lan22:55:551
22210991918,1cyclictest66850irq/125-lan22:32:511
22210991918,1cyclictest66850irq/125-lan22:20:421
22210991918,1cyclictest66850irq/125-lan20:00:401
22210991818,0cyclictest66850irq/125-lan23:21:181
22210991818,0cyclictest66850irq/125-lan22:54:241
22210991818,0cyclictest66850irq/125-lan21:50:031
22210991818,0cyclictest66850irq/125-lan21:38:461
22210991818,0cyclictest66850irq/125-lan21:20:181
22210991818,0cyclictest66850irq/125-lan21:12:121
22210991817,1cyclictest66850irq/125-lan23:50:161
22210991817,1cyclictest66850irq/125-lan23:46:151
22210991817,1cyclictest66850irq/125-lan23:35:131
22210991817,1cyclictest66850irq/125-lan22:37:281
22210991817,1cyclictest66850irq/125-lan22:25:221
22210991817,1cyclictest66850irq/125-lan22:15:181
22210991817,1cyclictest66850irq/125-lan21:55:121
22210991817,1cyclictest66850irq/125-lan20:45:131
22210991817,1cyclictest66850irq/125-lan19:45:181
22210991817,1cyclictest66850irq/125-lan19:15:171
22210991817,1cyclictest66850irq/125-lan00:30:171
22210991817,1cyclictest66850irq/125-lan00:20:171
22210991817,1cyclictest66850irq/125-lan00:20:001
22210991817,1cyclictest66850irq/125-lan00:11:301
22210991817,1cyclictest66850irq/125-lan00:00:471
22214991717,0cyclictest430-21cat19:35:152
22210991717,0cyclictest66850irq/125-lan23:05:151
22210991717,0cyclictest66850irq/125-lan23:05:151
22210991717,0cyclictest66850irq/125-lan22:47:491
22210991717,0cyclictest66850irq/125-lan22:06:441
22210991717,0cyclictest66850irq/125-lan20:35:121
22210991716,1cyclictest66850irq/125-lan23:41:271
22210991716,1cyclictest66850irq/125-lan23:00:191
22210991716,1cyclictest66850irq/125-lan22:40:171
22210991716,1cyclictest66850irq/125-lan22:10:311
22210991716,1cyclictest66850irq/125-lan21:47:471
22210991716,1cyclictest66850irq/125-lan21:40:371
22210991716,1cyclictest66850irq/125-lan21:30:141
22210991716,1cyclictest66850irq/125-lan21:25:061
22210991716,1cyclictest66850irq/125-lan21:19:011
22210991716,1cyclictest66850irq/125-lan21:05:221
22210991716,1cyclictest66850irq/125-lan19:20:161
22210991716,1cyclictest66850irq/125-lan00:36:401
22210991716,1cyclictest66850irq/125-lan00:08:261
22210991616,0cyclictest66850irq/125-lan23:32:041
22210991616,0cyclictest66850irq/125-lan23:17:571
22210991615,1cyclictest66850irq/125-lan23:27:361
22210991615,1cyclictest66850irq/125-lan23:13:251
22210991615,1cyclictest66850irq/125-lan20:30:001
22210991615,1cyclictest66850irq/125-lan19:50:181
22210991615,1cyclictest66850irq/125-lan19:30:111
22210991615,1cyclictest66850irq/125-lan00:26:061
22210991515,0cyclictest66850irq/125-lan20:10:191
22210991515,0cyclictest66850irq/125-lan19:35:121
22210991515,0cyclictest66850irq/125-lan19:25:171
22210991514,1cyclictest66850irq/125-lan21:00:121
22210991514,1cyclictest66850irq/125-lan20:50:181
22210991514,1cyclictest66850irq/125-lan20:26:411
22210991514,1cyclictest66850irq/125-lan20:05:111
22210991514,1cyclictest66850irq/125-lan19:12:471
22210991414,0cyclictest66850irq/125-lan20:55:171
22210991313,0cyclictest66850irq/125-lan20:20:161
22210991312,1cyclictest66850irq/125-lan20:40:151
22210991312,1cyclictest66850irq/125-lan20:40:141
22214991212,0cyclictest771-21snmpd23:36:002
22214991212,0cyclictest771-21snmpd22:13:092
22214991212,0cyclictest771-21snmpd19:44:492
22214991212,0cyclictest422-21cat22:05:152
22214991210,2cyclictest749-21ntpd00:14:252
22210991212,0cyclictest66850irq/125-lan20:19:171
22210991212,0cyclictest66850irq/125-lan19:55:201
22214991111,0cyclictest8530-21cat00:25:172
22214991111,0cyclictest7777-21cat23:50:132
22214991111,0cyclictest771-21snmpd23:45:302
22214991111,0cyclictest771-21snmpd23:04:312
22214991111,0cyclictest771-21snmpd22:29:542
22214991111,0cyclictest771-21snmpd22:23:422
22214991111,0cyclictest771-21snmpd20:02:302
22214991111,0cyclictest771-21snmpd19:10:082
22214991111,0cyclictest17125-21cat21:50:142
22214991010,0cyclictest771-21snmpd23:12:252
22214991010,0cyclictest771-21snmpd23:05:202
22214991010,0cyclictest771-21snmpd23:05:202
22214991010,0cyclictest771-21snmpd21:28:362
22214991010,0cyclictest771-21snmpd20:52:212
22214991010,0cyclictest771-21snmpd20:34:192
22214991010,0cyclictest771-21snmpd20:24:172
22214991010,0cyclictest771-21snmpd19:25:302
22214991010,0cyclictest28479-21cat21:30:152
2221099109,1cyclictest66850irq/125-lan19:40:141
222189998,1cyclictest771-21snmpd23:41:243
222189998,1cyclictest771-21snmpd23:31:503
222189998,1cyclictest771-21snmpd00:36:113
222149998,1cyclictest771-21snmpd19:16:112
222149998,1cyclictest771-21snmpd00:02:272
222069998,1cyclictest771-21snmpd22:57:040
222189988,0cyclictest771-21snmpd19:26:383
222189988,0cyclictest769-21lldpd23:08:103
222189988,0cyclictest769-21lldpd23:08:103
222189988,0cyclictest769-21lldpd21:56:083
222189988,0cyclictest769-21lldpd20:41:223
222189988,0cyclictest769-21lldpd20:41:213
222189988,0cyclictest769-21lldpd20:03:543
222189988,0cyclictest769-21lldpd19:43:313
222189988,0cyclictest524-21avahi-daemon20:22:583
222189987,1cyclictest771-21snmpd19:22:153
222189987,1cyclictest524-21avahi-daemon23:55:083
222189987,1cyclictest524-21avahi-daemon23:03:233
222189986,2cyclictest771-21snmpd23:50:363
222189986,2cyclictest771-21snmpd23:37:183
222189986,2cyclictest771-21snmpd20:59:593
222189986,2cyclictest771-21snmpd19:54:493
222189986,2cyclictest771-21snmpd00:19:313
222189986,2cyclictest771-21snmpd00:11:133
222149988,0cyclictest771-21snmpd20:43:392
222149988,0cyclictest771-21snmpd20:43:382
222149988,0cyclictest771-21snmpd00:30:072
222149988,0cyclictest769-21lldpd23:26:252
222149988,0cyclictest769-21lldpd22:55:322
222149988,0cyclictest769-21lldpd22:42:232
222149988,0cyclictest769-21lldpd22:03:272
222149988,0cyclictest769-21lldpd21:06:362
222149988,0cyclictest769-21lldpd20:07:152
222149988,0cyclictest769-21lldpd19:30:402
222149987,1cyclictest771-21snmpd23:55:052
222149987,1cyclictest771-21snmpd21:12:242
222149986,2cyclictest771-21snmpd20:15:102
222149986,2cyclictest749-21ntpd23:40:462
222149986,2cyclictest749-21ntpd21:46:432
222149986,2cyclictest749-21ntpd21:19:372
222069988,0cyclictest771-21snmpd21:06:330
222069988,0cyclictest771-21snmpd19:25:090
222069988,0cyclictest771-21snmpd00:31:130
222069988,0cyclictest769-21lldpd20:01:270
222069988,0cyclictest769-21lldpd19:45:560
222069988,0cyclictest769-21lldpd19:38:000
222069988,0cyclictest769-21lldpd00:25:050
222069987,1cyclictest524-21avahi-daemon00:14:270
222069987,1cyclictest517-21systemd-resolve23:25:400
222189977,0cyclictest771-21snmpd23:49:093
222189977,0cyclictest771-21snmpd22:58:493
222189977,0cyclictest771-21snmpd22:49:213
222189977,0cyclictest771-21snmpd21:02:543
222189977,0cyclictest771-21snmpd19:56:193
222189977,0cyclictest769-21lldpd22:10:143
222189977,0cyclictest769-21lldpd22:05:193
222189977,0cyclictest769-21lldpd21:47:053
222189976,1cyclictest771-21snmpd23:25:353
222189976,1cyclictest771-21snmpd21:13:213
222189976,1cyclictest771-21snmpd20:26:353
222189976,1cyclictest769-21lldpd22:31:073
222189976,1cyclictest28700-21needreboot21:30:163
222189976,1cyclictest11185-21needreboot22:15:193
222189975,2cyclictest771-21snmpd22:39:223
222189975,2cyclictest771-21snmpd21:26:573
222189975,2cyclictest771-21snmpd21:19:013
222189975,2cyclictest771-21snmpd20:31:493
222189975,2cyclictest27663-21cat22:00:153
222149977,0cyclictest771-21snmpd23:18:232
222149977,0cyclictest771-21snmpd20:39:292
222149977,0cyclictest771-21snmpd19:48:182
222149976,1cyclictest771-21snmpd21:40:222
222149975,2cyclictest749-21ntpd21:24:372
222149975,2cyclictest749-21ntpd00:35:022
222149975,2cyclictest749-21ntpd00:23:002
222149973,3cyclictest9353-21ntp_states22:45:162
222149972,5cyclictest550-21NetworkManager23:20:132
222069977,0cyclictest771-21snmpd21:41:560
222069977,0cyclictest771-21snmpd20:58:150
222069977,0cyclictest771-21snmpd20:14:560
222069977,0cyclictest771-21snmpd20:07:180
222069977,0cyclictest769-21lldpd23:46:420
222069977,0cyclictest769-21lldpd22:52:580
222069977,0cyclictest769-21lldpd22:17:000
222069977,0cyclictest769-21lldpd22:12:410
222069977,0cyclictest769-21lldpd20:50:160
222069977,0cyclictest517-21systemd-resolve20:23:510
222069976,1cyclictest771-21snmpd23:41:560
222069976,1cyclictest771-21snmpd22:09:360
222069976,1cyclictest771-21snmpd21:46:250
222069976,1cyclictest771-21snmpd19:11:150
222069976,1cyclictest771-21snmpd00:17:580
222069976,1cyclictest22035-21cpuspeed_turbos00:05:130
222069975,2cyclictest771-21snmpd23:06:530
222069975,2cyclictest771-21snmpd23:06:530
222069975,2cyclictest771-21snmpd21:56:350
222069975,2cyclictest771-21snmpd20:43:030
222069975,2cyclictest771-21snmpd20:43:030
222069975,2cyclictest771-21snmpd20:15:470
222069975,2cyclictest771-21snmpd19:59:520
222069975,2cyclictest771-21snmpd00:24:550
222069973,3cyclictest9567-21sed22:45:190
222069973,3cyclictest7647-21ssh22:44:250
222069973,3cyclictest3343-21ssh21:36:510
222189966,0cyclictest771-21snmpd00:34:223
222189966,0cyclictest769-21lldpd19:36:033
222189966,0cyclictest517-21systemd-resolve23:15:293
222189965,1cyclictest771-21snmpd20:46:063
222189965,1cyclictest771-21snmpd19:32:503
222189964,2cyclictest550-21NetworkManager00:06:303
222189964,2cyclictest13398-21grep22:50:133
222189963,3cyclictest6372-21perl21:40:113
222189963,3cyclictest16297-21sed20:10:253
222189963,2cyclictest821-21apt-get21:35:123
222189963,2cyclictest255-20systemd-journal21:20:153
222189963,2cyclictest255-20systemd-journal20:35:133
222189963,2cyclictest1424-21ntpq23:10:163
222189962,3cyclictest3843-21fw_packets00:20:123
222189961,5cyclictest550-21NetworkManager19:49:113
222149966,0cyclictest771-21snmpd22:30:532
222149966,0cyclictest769-21lldpd20:14:572
222149966,0cyclictest769-21lldpd19:55:092
222149965,1cyclictest749-21ntpd21:59:132
222149965,1cyclictest749-21ntpd21:37:072
222149965,1cyclictest749-21ntpd00:17:102
222149965,1cyclictest22620-21needreboot00:05:162
222149964,2cyclictest749-21ntpd23:30:132
222149962,3cyclictest13670-21fw_conntrack22:50:142
222069966,0cyclictest771-21snmpd20:29:200
222069966,0cyclictest769-21lldpd23:02:310
222069966,0cyclictest769-21lldpd22:20:250
222069966,0cyclictest769-21lldpd19:15:390
222069965,1cyclictest884-21fschecks_count23:10:120
222069965,1cyclictest517-21systemd-resolve21:12:170
222069965,1cyclictest3184-21gltestperf21:00:140
222069965,1cyclictest0-21swapper/020:40:000
222069964,2cyclictest771-21snmpd21:50:140
222069964,2cyclictest771-21snmpd20:46:560
222069964,2cyclictest771-21snmpd19:43:010
222069964,2cyclictest255-20systemd-journal00:00:160
222069963,3cyclictest550-21NetworkManager23:31:570
222069963,3cyclictest550-21NetworkManager19:23:560
222069963,2cyclictest255-20systemd-journal00:36:340
222069962,3cyclictest30566-21ssh22:02:570
222069962,3cyclictest28541-21ssh23:39:040
222069962,3cyclictest20501-21seq21:22:130
222069962,3cyclictest14681-21ssh23:56:590
222189955,0cyclictest769-21lldpd21:52:153
222189954,1cyclictest8928-21ntpq00:25:193
222189954,1cyclictest0-21swapper/322:20:173
222189953,2cyclictest26712-21kworker/u16:0+nfsiod22:25:093
222189952,2cyclictest5657-21ssh22:41:293
222189952,2cyclictest255-20systemd-journal20:08:163
222189952,2cyclictest25205-21ld19:15:163
222189952,2cyclictest10444-21forks23:20:163
222189951,3cyclictest17419-21fw_forwarded_lo00:00:153
222189950,5cyclictest23207-21ntpq19:10:173
222149955,0cyclictest769-21lldpd19:24:482
222149954,1cyclictest771-21snmpd22:16:052
222149954,1cyclictest6203-21cpuspeed_turbos19:50:132
222149953,2cyclictest749-21ntpd20:57:102
222149952,2cyclictest32279-21ssh22:35:262
222149952,2cyclictest255-20systemd-journal21:01:042
222149952,2cyclictest21911-21awk20:25:192
222069955,0cyclictest771-21snmpd23:19:260
222069955,0cyclictest771-21snmpd21:30:000
222069955,0cyclictest769-21lldpd20:30:050
222069954,1cyclictest171ktimers/022:30:000
222069953,2cyclictest771-21snmpd19:30:410
222069953,2cyclictest550-21NetworkManager22:28:240
222069953,2cyclictest31248-21cat22:35:150
222069953,0cyclictest0-21swapper/021:16:350
222069952,2cyclictest7203-21ssh23:50:030
222069952,2cyclictest10674-21ls23:20:170
222069951,3cyclictest7459-21sed19:50:210
222069950,4cyclictest23748-21ntpq21:25:200
222189941,2cyclictest31240-21grep20:50:133
222189941,2cyclictest255-20systemd-journal20:18:153
222189940,4cyclictest5593-21ntpq21:05:183
222149941,2cyclictest29871-21awk20:45:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional