You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-03 - 15:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Wed Dec 03, 2025 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28465212097,18sleep00-21swapper/007:06:480
285072116105,6sleep20-21swapper/207:07:222
285352115104,6sleep30-21swapper/307:07:423
28649211194,12sleep10-21swapper/107:09:091
8072680,1sleep229-21rcuc/208:40:122
2874799340,32cyclictest0-21swapper/312:15:123
41732270,0sleep00-21swapper/008:45:270
235382270,0sleep10-21swapper/111:05:121
2874699221,19cyclictest0-21swapper/210:15:112
2874699221,19cyclictest0-21swapper/209:15:122
2874699220,5cyclictest0-21swapper/209:42:012
2874599220,17cyclictest0-21swapper/111:54:051
2874699215,2cyclictest301ktimersoftd/212:21:042
28746992118,2cyclictest9140-21kworker/u8:112:34:062
2874699210,19cyclictest0-21swapper/211:35:122
28745992118,2cyclictest6530-21kworker/u8:210:51:051
28745992118,2cyclictest16613-21kworker/u8:208:04:051
28745992118,2cyclictest1410-21kworker/u8:210:20:041
2874499210,19cyclictest0-21swapper/010:15:110
28746992017,2cyclictest8890-21kworker/u8:209:45:052
28746992017,2cyclictest8723-21kworker/u8:112:08:052
28746992017,2cyclictest8313-21kworker/u8:007:38:052
28746992017,2cyclictest27116-21kworker/u8:210:40:052
28746992017,2cyclictest20481-21kworker/u8:311:14:052
28746992017,2cyclictest17071-21kworker/u8:010:23:042
28746992016,2cyclictest0-21swapper/207:50:112
2874699200,18cyclictest0-21swapper/211:45:122
2874599204,2cyclictest0-21swapper/112:21:041
28745992017,2cyclictest4022-21kworker/u8:207:26:021
28745992017,2cyclictest27116-21kworker/u8:210:39:051
28745992017,2cyclictest26555-21kworker/u8:009:32:041
28745992017,2cyclictest25084-21kworker/u8:107:35:041
28745992017,2cyclictest25022-21kworker/u8:010:05:051
28745992017,2cyclictest19170-21kworker/u8:008:15:051
28745992017,2cyclictest18802-21kworker/u8:012:15:051
28745992017,2cyclictest1410-21kworker/u8:210:18:061
28745992017,2cyclictest12469-21kworker/u8:110:57:041
28745992017,2cyclictest12082-21kworker/u8:312:09:051
2874599200,4cyclictest0-21swapper/109:42:021
2874599200,18cyclictest0-21swapper/110:00:131
28746991916,2cyclictest8313-21kworker/u8:007:55:042
28746991916,2cyclictest8313-21kworker/u8:007:45:042
28746991916,2cyclictest4426-21kworker/u8:009:08:012
28746991916,2cyclictest4426-21kworker/u8:009:00:052
28746991916,2cyclictest26742-21kworker/u8:008:32:052
28746991916,2cyclictest25427-21kworker/u8:011:07:042
28746991916,2cyclictest25084-21kworker/u8:107:16:022
28746991916,2cyclictest25022-21kworker/u8:010:00:052
28746991916,2cyclictest1116-21kworker/u8:109:33:042
2874699191,2cyclictest0-21swapper/208:47:042
2874699190,14cyclictest0-21swapper/208:50:052
28745991916,2cyclictest6966-21kworker/u8:310:12:021
28745991916,2cyclictest30982-21kworker/u8:109:15:051
28745991916,2cyclictest26742-21kworker/u8:008:39:041
28745991916,2cyclictest25084-21kworker/u8:107:57:051
28745991916,2cyclictest25084-21kworker/u8:107:19:051
28745991916,2cyclictest12082-21kworker/u8:311:35:051
2874599190,2cyclictest0-21swapper/108:47:041
2874599190,15cyclictest0-21swapper/108:06:021
158572190,0sleep20-21swapper/211:30:262
2874699182,2cyclictest0-21swapper/211:04:022
28746991815,2cyclictest23082-21kworker/u8:208:19:052
28746991815,2cyclictest21780-21kworker/u8:309:24:052
2874699181,2cyclictest0-21swapper/210:50:052
2874699180,2cyclictest0-21swapper/212:26:052
28745991815,2cyclictest9140-21kworker/u8:112:38:041
28745991815,2cyclictest8313-21kworker/u8:007:46:041
28745991815,2cyclictest4426-21kworker/u8:009:06:041
28745991815,2cyclictest4426-21kworker/u8:008:58:051
28745991815,2cyclictest4426-21kworker/u8:008:58:041
28745991815,2cyclictest25084-21kworker/u8:107:21:041
28745991815,2cyclictest23082-21kworker/u8:208:29:051
28745991815,2cyclictest12469-21kworker/u8:111:03:051
28745991815,2cyclictest12082-21kworker/u8:311:42:051
2874599180,13cyclictest0-21swapper/109:51:051
86422170,1sleep30-21swapper/311:58:093
28746991714,2cyclictest9362-21kworker/u8:207:10:052
28746991714,2cyclictest25084-21kworker/u8:107:20:052
2874699171,2cyclictest0-21swapper/211:50:052
2874699170,2cyclictest0-21swapper/209:12:062
28745991714,2cyclictest9362-21kworker/u8:207:14:041
28745991714,2cyclictest7748-21kworker/u8:211:25:051
28745991714,2cyclictest26555-21kworker/u8:009:36:051
28745991714,2cyclictest26555-21kworker/u8:009:28:051
28745991714,2cyclictest23082-21kworker/u8:208:22:011
28745991714,2cyclictest19170-21kworker/u8:008:13:041
2874599170,2cyclictest0-21swapper/112:26:051
2874599170,2cyclictest0-21swapper/109:12:061
2874599170,2cyclictest0-21swapper/108:31:051
2874799162,8cyclictest28544-21ssh12:19:593
2874799161,3cyclictest24557-21munin-node3
2874799161,13cyclictest0-21swapper/312:25:213
28747991611,3cyclictest0-21swapper/309:50:163
2874799160,14cyclictest0-21swapper/310:06:393
2874699160,2cyclictest0-21swapper/212:37:042
2874699160,2cyclictest0-21swapper/211:55:042
2874699160,2cyclictest0-21swapper/210:45:052
2874699160,15cyclictest0-21swapper/209:54:052
28745991613,2cyclictest21780-21kworker/u8:309:21:041
2874599160,2cyclictest0-21swapper/111:55:041
2874599160,2cyclictest0-21swapper/111:45:041
2874499161,13cyclictest1617-21tr08:40:170
2874799152,6cyclictest0-21swapper/311:55:013
2874799151,3cyclictest5505-21irqstats10:45:173
2874799151,3cyclictest15533-21iostat_ios12:05:213
28747991510,3cyclictest15338-21ssh09:45:513
2874799150,13cyclictest17686-21ssh10:24:063
28746991512,2cyclictest0-21swapper/210:10:152
2874699151,12cyclictest27868-21apt-get10:35:132
28746991510,3cyclictest0-21swapper/210:28:252
2874699150,2cyclictest3506-21ssh11:18:052
2874699150,2cyclictest0-21swapper/212:00:022
2874699150,2cyclictest0-21swapper/210:08:142
2874699150,2cyclictest0-21swapper/209:35:052
2874699150,2cyclictest0-21swapper/209:25:052
2874699150,2cyclictest0-21swapper/208:36:012
2874699150,14cyclictest0-21swapper/208:10:042
2874699150,13cyclictest0-21swapper/212:19:382
2874599150,2cyclictest0-21swapper/112:00:021
2874599150,2cyclictest0-21swapper/111:18:051
2874599150,2cyclictest0-21swapper/109:59:041
2874599150,2cyclictest0-21swapper/108:53:051
2874599150,2cyclictest0-21swapper/108:42:021
2874499151,2cyclictest12808-21diskmemload10:25:250
28744991511,2cyclictest0-21swapper/008:25:240
2874499150,13cyclictest0-21swapper/010:57:300
2874799142,7cyclictest12808-21diskmemload12:05:003
2874799142,7cyclictest0-21swapper/310:00:003
2874799142,7cyclictest0-21swapper/308:25:003
2874799142,6cyclictest0-21swapper/309:15:013
2874799142,6cyclictest0-21swapper/307:15:003
2874799141,2cyclictest0-21swapper/312:10:053
28747991411,2cyclictest0-21swapper/311:15:203
28747991410,2cyclictest20749-21ssh11:35:363
28747991410,2cyclictest0-21swapper/310:17:253
28747991410,2cyclictest0-21swapper/309:20:123
2874799140,3cyclictest1495-21ssh09:31:253
2874799140,2cyclictest0-21swapper/311:24:313
2874799140,2cyclictest0-21swapper/311:02:593
2874799140,12cyclictest6569-21ssh09:36:493
2874799140,12cyclictest12808-21diskmemload10:50:073
2874799140,12cyclictest0-21swapper/311:30:263
2874799140,12cyclictest0-21swapper/310:28:413
2874799140,12cyclictest0-21swapper/310:00:133
28746991411,2cyclictest0-21swapper/211:28:042
2874699140,3cyclictest0-21swapper/212:10:042
2874699140,2cyclictest0-21swapper/209:57:342
28745991411,2cyclictest12808-21diskmemload11:13:071
2874599140,2cyclictest0-21swapper/111:34:171
2874599140,2cyclictest0-21swapper/110:45:041
2874599140,2cyclictest0-21swapper/110:43:051
2874599140,2cyclictest0-21swapper/110:29:481
2874599140,2cyclictest0-21swapper/109:01:051
2874499141,2cyclictest30755-21munin-run07:14:590
28744991410,2cyclictest0-21swapper/011:00:170
2874499140,13cyclictest0-21swapper/007:50:150
2874499140,12cyclictest26655-21sh11:42:390
2874499140,12cyclictest13575-21telnet09:45:110
2874499140,12cyclictest12808-21diskmemload11:06:410
2874499140,12cyclictest0-21swapper/011:53:340
2874499140,12cyclictest0-21swapper/011:36:070
2874499140,12cyclictest0-21swapper/010:10:160
2874499140,12cyclictest0-21swapper/009:59:000
2874499140,12cyclictest0-21swapper/009:26:150
2874499140,12cyclictest0-21swapper/009:22:030
2874499140,12cyclictest0-21swapper/009:19:210
2874499140,12cyclictest0-21swapper/008:30:050
99242130,2sleep10-21swapper/112:34:571
2874799133,6cyclictest0-21swapper/308:35:243
2874799132,6cyclictest0-21swapper/312:30:003
28747991310,2cyclictest0-21swapper/310:41:263
28747991310,2cyclictest0-21swapper/310:32:393
28747991310,2cyclictest0-21swapper/307:25:263
2874799130,2cyclictest0-21swapper/311:47:553
2874799130,2cyclictest0-21swapper/311:10:403
2874799130,2cyclictest0-21swapper/311:05:143
2874799130,2cyclictest0-21swapper/310:36:013
2874799130,2cyclictest0-21swapper/308:05:123
2874799130,12cyclictest0-21swapper/311:27:293
2874799130,12cyclictest0-21swapper/310:58:393
28746991310,2cyclictest0-21swapper/210:33:442
2874699130,1cyclictest0-21swapper/208:21:042
2874699130,12cyclictest0-21swapper/211:20:032
28745991310,2cyclictest0-21swapper/107:40:251
2874599130,2cyclictest0-21swapper/107:52:051
2874599130,12cyclictest0-21swapper/112:12:331
28744991310,2cyclictest8846-21apt-get07:40:120
28744991310,2cyclictest12808-21diskmemload12:14:000
28744991310,2cyclictest12808-21diskmemload09:13:540
28744991310,2cyclictest12402-21ssh12:36:220
28744991310,2cyclictest0-21swapper/012:02:210
28744991310,2cyclictest0-21swapper/011:30:150
28744991310,2cyclictest0-21swapper/011:25:340
28744991310,2cyclictest0-21swapper/011:21:240
28744991310,2cyclictest0-21swapper/010:22:270
28744991310,2cyclictest0-21swapper/010:05:120
28744991310,2cyclictest0-21swapper/009:40:320
28744991310,2cyclictest0-21swapper/009:36:030
28744991310,2cyclictest0-21swapper/009:30:340
2874499130,2cyclictest0-21swapper/012:30:340
2874499130,2cyclictest0-21swapper/012:15:140
2874499130,2cyclictest0-21swapper/012:05:280
2874499130,2cyclictest0-21swapper/011:45:180
2874499130,2cyclictest0-21swapper/011:10:100
2874499130,2cyclictest0-21swapper/010:45:220
2874499130,2cyclictest0-21swapper/010:40:240
2874499130,2cyclictest0-21swapper/010:38:310
2874499130,12cyclictest0-21swapper/012:25:020
2874499130,12cyclictest0-21swapper/012:20:190
2874499130,11cyclictest0-21swapper/011:17:570
2874499130,11cyclictest0-21swapper/010:00:210
257182130,2sleep20-21swapper/211:41:062
2874799127,3cyclictest12808-21diskmemload09:25:163
2874799127,3cyclictest10247-21ssh12:35:073
2874799122,7cyclictest0-21swapper/310:10:023
2874799122,7cyclictest0-21swapper/308:54:593
2874799122,7cyclictest0-21swapper/308:48:013
2874799120,1cyclictest0-21swapper/309:15:083
2874799120,11cyclictest0-21swapper/309:42:093
2874799120,11cyclictest0-21swapper/308:30:183
2874699129,2cyclictest0-21swapper/207:25:152
2874699120,2cyclictest10559-21seq07:44:052
2874699120,2cyclictest0-21swapper/208:05:052
2874699120,2cyclictest0-21swapper/207:30:232
2874699120,11cyclictest0-21swapper/210:55:132
2874699120,11cyclictest0-21swapper/208:25:142
2874599129,2cyclictest0-21swapper/110:31:051
2874599129,2cyclictest0-21swapper/109:45:561
2874599120,2cyclictest0-21swapper/107:30:051
2874499122,6cyclictest0-21swapper/008:10:230
2874499120,2cyclictest0-21swapper/010:50:190
2874499120,2cyclictest0-21swapper/007:15:190
2874499120,11cyclictest0-21swapper/011:55:330
2874499120,11cyclictest0-21swapper/010:32:020
2874499120,11cyclictest0-21swapper/009:52:020
2874499120,11cyclictest0-21swapper/009:05:140
2874499120,11cyclictest0-21swapper/008:54:030
2874799118,2cyclictest0-21swapper/307:45:013
2874799118,2cyclictest0-21swapper/307:39:003
2874799112,7cyclictest0-21swapper/309:06:583
2874799112,7cyclictest0-21swapper/308:28:593
2874799112,7cyclictest0-21swapper/308:18:593
2874799111,7cyclictest0-21swapper/307:42:593
2874799110,9cyclictest5010-21snmpd07:33:573
2874799110,2cyclictest0-21swapper/308:58:223
2874799110,2cyclictest0-21swapper/308:58:213
2874699116,3cyclictest18182-21smartctl08:00:272
2874599110,3cyclictest12808-21diskmemload11:20:201
2874499118,2cyclictest0-21swapper/008:15:250
2874499112,5cyclictest6582-21apt-get07:35:000
2874499110,10cyclictest0-21swapper/009:00:270
2874799107,2cyclictest0-21swapper/307:15:273
2874799105,3cyclictest13976-21python07:50:243
2874799102,5cyclictest0-21swapper/309:01:593
2874799102,5cyclictest0-21swapper/308:44:593
2874799101,7cyclictest28743-21cyclictest07:23:583
2874699105,3cyclictest7267-21grep08:55:142
2874699105,3cyclictest7267-21grep08:55:132
2874499105,3cyclictest584-21basename07:20:130
2874499105,3cyclictest25368-21tr08:20:150
2874499105,3cyclictest17339-21tr08:00:150
2874499103,6cyclictest0-21swapper/007:28:570
287479994,3cyclictest22267-21switchtime08:10:263
287479992,4cyclictest0-21swapper/308:00:083
287479991,6cyclictest0-21swapper/307:55:233
287449996,2cyclictest0-21swapper/008:35:160
287449996,2cyclictest0-21swapper/008:05:120
287449996,2cyclictest0-21swapper/007:57:230
287449994,3cyclictest0-21swapper/007:35:280
287449991,6cyclictest11153-21tr07:45:130
287449991,6cyclictest0-21swapper/008:55:240
287449991,6cyclictest0-21swapper/008:55:230
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional