You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-19 - 14:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Wed Nov 19, 2025 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
18948211697,14sleep30-21swapper/307:07:233
189462116105,6sleep10-21swapper/107:07:201
18276211698,11sleep20-21swapper/207:05:222
190262113102,6sleep00-21swapper/007:08:190
3139221050,1sleep031390-21ssh09:39:410
173072760,3sleep229-21rcuc/210:32:142
137342730,1sleep00-21swapper/011:02:590
19188992711,14cyclictest0-21swapper/311:20:153
55492260,1sleep05505-21copy10:55:000
163122240,1sleep10-21swapper/109:23:111
19187992219,2cyclictest10595-21kworker/u8:011:08:042
1918499222,18cyclictest15987-21diskmemload11:40:010
1918499220,17cyclictest0-21swapper/009:47:050
55522210,0sleep10-21swapper/112:02:281
19188992118,2cyclictest2816-21kworker/u8:012:07:043
19188992116,3cyclictest10735-21kworker/u8:112:16:013
19187992118,2cyclictest25357-21kworker/u8:010:14:042
19187992118,2cyclictest24018-21kworker/u8:107:36:042
19187992118,2cyclictest23293-21kworker/u8:109:15:052
19187992118,2cyclictest17018-21kworker/u8:210:58:052
19187992118,2cyclictest10735-21kworker/u8:112:08:042
19187992118,2cyclictest10705-21kworker/u8:009:33:052
19187992118,2cyclictest10595-21kworker/u8:011:30:052
1918799211,18cyclictest0-21swapper/208:40:152
1918799210,4cyclictest0-21swapper/211:41:042
19185992117,3cyclictest0-21swapper/111:20:151
140222210,0sleep30-21swapper/311:03:253
19188992016,3cyclictest17253-21kworker/u8:109:30:053
19187992017,2cyclictest4698-21kworker/u8:010:24:052
19187992017,2cyclictest31880-21kworker/u8:207:47:042
19187992017,2cyclictest27580-21kworker/u8:212:04:012
19187992017,2cyclictest27580-21kworker/u8:211:58:052
19187992017,2cyclictest27479-21kworker/u8:007:32:022
19187992017,2cyclictest26796-21kworker/u8:111:23:052
19187992017,2cyclictest19718-21kworker/u8:008:45:042
19187992017,2cyclictest17123-21kworker/u8:110:02:042
19187992016,2cyclictest0-21swapper/210:05:132
1918799200,18cyclictest0-21swapper/208:30:152
1918499200,18cyclictest0-21swapper/008:40:140
1918899190,2cyclictest0-21swapper/310:56:053
19187991916,2cyclictest27395-21kworker/u8:209:39:042
19187991916,2cyclictest26796-21kworker/u8:111:17:042
19187991916,2cyclictest24018-21kworker/u8:108:05:052
19187991916,2cyclictest21848-21kworker/u8:211:11:052
19187991916,2cyclictest17018-21kworker/u8:210:38:042
19187991916,2cyclictest13580-21kworker/u8:208:21:042
1918799191,16cyclictest0-21swapper/208:55:142
1918799190,2cyclictest0-21swapper/212:18:052
1918799190,14cyclictest0-21swapper/209:57:032
1918499190,14cyclictest0-21swapper/009:56:050
19188991815,2cyclictest2427-21kworker/u8:109:46:043
19188991814,2cyclictest23293-21kworker/u8:109:16:053
1918899181,2cyclictest3091-21diskmemload12:31:043
19187991815,2cyclictest6704-21kworker/u8:111:50:042
19187991815,2cyclictest2427-21kworker/u8:109:49:052
19187991815,2cyclictest24018-21kworker/u8:108:01:042
19187991815,2cyclictest24018-21kworker/u8:107:41:052
19187991815,2cyclictest24018-21kworker/u8:107:23:052
19187991815,2cyclictest24018-21kworker/u8:107:23:042
19187991815,2cyclictest23293-21kworker/u8:108:39:042
19187991815,2cyclictest10735-21kworker/u8:112:20:052
1918799180,2cyclictest0-21swapper/211:04:052
1918799180,2cyclictest0-21swapper/209:41:052
1918799180,2cyclictest0-21swapper/209:29:042
19188991714,2cyclictest31182-21kworker/u8:010:47:053
19188991714,2cyclictest27580-21kworker/u8:212:12:053
19188991714,2cyclictest21848-21kworker/u8:211:15:043
19188991714,2cyclictest17018-21kworker/u8:210:44:023
19188991714,2cyclictest10705-21kworker/u8:009:51:043
19188991714,2cyclictest10595-21kworker/u8:011:32:053
19188991713,2cyclictest32185-21kworker/u8:110:17:043
1918899171,14cyclictest30863-21apt12:29:593
19188991710,2cyclictest0-21swapper/310:03:043
19187991714,2cyclictest4847-21kworker/u8:008:15:052
19187991714,2cyclictest4847-21kworker/u8:008:11:042
19187991714,2cyclictest31353-21kworker/u8:009:02:042
19187991714,2cyclictest24018-21kworker/u8:107:54:052
19187991714,2cyclictest13580-21kworker/u8:208:26:042
1918799170,13cyclictest0-21swapper/207:11:052
1918899161,3cyclictest32275-21perl07:40:153
1918899161,3cyclictest32235-21sort09:00:173
19188991613,2cyclictest869-21kworker/u8:211:28:013
19188991613,2cyclictest4055-21kworker/u8:110:54:043
19188991613,2cyclictest27580-21kworker/u8:211:59:053
19188991613,2cyclictest2427-21kworker/u8:109:44:053
19188991613,2cyclictest10705-21kworker/u8:009:28:043
19188991613,2cyclictest10595-21kworker/u8:011:35:043
1918899160,11cyclictest0-21swapper/309:37:043
1918899160,11cyclictest0-21swapper/309:10:043
19187991611,3cyclictest13913-21ssh12:10:322
1918799160,2cyclictest0-21swapper/210:43:042
1918799160,2cyclictest0-21swapper/209:21:052
1918799160,1cyclictest0-21swapper/207:16:012
1918599161,2cyclictest25251-21apt-get11:50:041
1918599161,13cyclictest5443-21apt-get10:55:061
1918499160,11cyclictest0-21swapper/010:41:040
1918499160,10cyclictest0-21swapper/008:56:050
19188991512,2cyclictest8595-21kworker/u8:210:12:013
19188991512,2cyclictest6704-21kworker/u8:111:53:043
19188991512,2cyclictest6704-21kworker/u8:111:46:053
19188991512,2cyclictest24018-21kworker/u8:107:29:053
19188991512,2cyclictest23293-21kworker/u8:108:50:053
19188991512,2cyclictest17018-21kworker/u8:210:39:043
19188991512,2cyclictest13580-21kworker/u8:208:37:043
19188991512,2cyclictest10705-21kworker/u8:009:20:043
1918899151,12cyclictest15197-21sed09:55:273
19188991511,2cyclictest0-21swapper/308:00:143
19187991512,2cyclictest25826-21kworker/u8:208:54:042
19187991512,2cyclictest0-21swapper/211:26:112
1918799150,2cyclictest0-21swapper/211:36:052
1918599155,7cyclictest0-21swapper/110:20:261
19185991511,2cyclictest5129-21runrttasks10:16:041
1918599151,12cyclictest27165-21ssh10:42:551
1918599150,3cyclictest31993-21aten2.4-expect09:40:141
1918599150,13cyclictest3091-21diskmemload11:30:141
1918599150,13cyclictest3091-21diskmemload09:25:441
1918599150,13cyclictest10735-21kworker/u8:112:18:011
19184991512,2cyclictest3091-21diskmemload11:12:570
19184991511,2cyclictest0-21swapper/008:25:140
1918499150,13cyclictest0-21swapper/011:54:460
1918499150,13cyclictest0-21swapper/007:15:190
1918899149,3cyclictest25055-21munin-node3
19188991411,2cyclictest4847-21kworker/u8:007:52:053
19188991411,2cyclictest17096-21kworker/u8:012:21:053
19188991411,2cyclictest13580-21kworker/u8:208:31:053
19188991411,2cyclictest13580-21kworker/u8:208:20:043
19188991411,2cyclictest10595-21kworker/u8:011:10:043
19188991411,2cyclictest0-21swapper/308:10:043
1918899140,12cyclictest3091-21diskmemload12:00:543
1918899140,12cyclictest0-21swapper/310:25:013
1918799141,2cyclictest0-21swapper/210:15:142
19187991411,2cyclictest0-21swapper/210:26:012
1918799140,13cyclictest0-21swapper/212:37:022
1918799140,12cyclictest32127-21ssh10:48:232
1918799140,12cyclictest0-21swapper/210:51:122
1918799140,12cyclictest0-21swapper/209:50:242
1918599146,5cyclictest0-21swapper/108:16:591
19185991411,2cyclictest0-21swapper/112:09:341
19185991411,2cyclictest0-21swapper/111:55:241
1918599140,2cyclictest0-21swapper/111:45:151
1918599140,2cyclictest0-21swapper/110:37:351
1918599140,2cyclictest0-21swapper/110:26:341
1918599140,12cyclictest3091-21diskmemload12:25:141
1918599140,12cyclictest0-21swapper/111:35:141
1918599140,12cyclictest0-21swapper/110:12:161
1918599140,12cyclictest0-21swapper/109:11:341
1918499141,2cyclictest0-21swapper/009:11:050
19184991411,2cyclictest17340-21ssh10:32:160
19184991411,2cyclictest0-21swapper/012:28:470
19184991411,2cyclictest0-21swapper/011:49:470
19184991411,2cyclictest0-21swapper/011:31:060
19184991411,2cyclictest0-21swapper/011:08:260
19184991411,2cyclictest0-21swapper/010:24:370
19184991411,2cyclictest0-21swapper/009:51:160
1918499141,11cyclictest15622-21apt-get08:20:130
19184991410,2cyclictest29032-21processes10:10:200
19184991410,2cyclictest0-21swapper/009:41:390
1918499140,2cyclictest4675-21ssh12:01:070
1918499140,2cyclictest0-21swapper/012:35:160
1918499140,2cyclictest0-21swapper/011:17:560
1918499140,2cyclictest0-21swapper/010:49:270
1918499140,13cyclictest3091-21diskmemload12:12:270
1918499140,13cyclictest0-21swapper/010:35:270
1918499140,12cyclictest0-21swapper/012:06:060
1918499140,12cyclictest0-21swapper/010:55:290
1918499140,12cyclictest0-21swapper/010:25:000
1918499140,12cyclictest0-21swapper/010:18:160
276852130,1sleep1221ktimersoftd/110:10:001
19188991310,2cyclictest4698-21kworker/u8:010:22:053
19188991310,2cyclictest30022-21kworker/u8:107:12:043
19188991310,2cyclictest25826-21kworker/u8:208:57:043
19188991310,2cyclictest24018-21kworker/u8:107:45:043
19188991310,2cyclictest2399-21kworker/u8:012:35:053
19188991310,2cyclictest21184-21kworker/u8:007:15:043
19188991310,2cyclictest17018-21kworker/u8:211:05:053
19188991310,2cyclictest13580-21kworker/u8:208:27:053
19188991310,2cyclictest0-21swapper/308:45:143
1918899130,2cyclictest15742-21apt-get11:40:053
1918899130,2cyclictest0-21swapper/310:05:283
1918899130,2cyclictest0-21swapper/309:05:133
1918899130,12cyclictest0-21swapper/308:05:163
1918799131,7cyclictest0-21swapper/212:35:002
19187991310,2cyclictest0-21swapper/211:49:322
1918799130,2cyclictest0-21swapper/207:56:052
1918799130,11cyclictest0-21swapper/212:25:402
1918599138,3cyclictest3091-21diskmemload09:30:181
1918599135,5cyclictest0-21swapper/108:14:581
1918599132,9cyclictest25753-21grep07:25:141
19185991310,2cyclictest3091-21diskmemload10:30:151
19185991310,2cyclictest0-21swapper/112:21:141
19185991310,2cyclictest0-21swapper/112:10:251
19185991310,2cyclictest0-21swapper/111:25:491
19185991310,2cyclictest0-21swapper/111:02:441
19185991310,2cyclictest0-21swapper/110:51:151
19185991310,2cyclictest0-21swapper/109:57:071
19185991310,2cyclictest0-21swapper/108:50:241
1918599130,2cyclictest0-21swapper/108:45:241
1918599130,12cyclictest31880-21kworker/u8:207:51:041
1918599130,12cyclictest0-21swapper/112:33:251
1918599130,12cyclictest0-21swapper/111:12:251
1918599130,12cyclictest0-21swapper/109:52:361
1918599130,12cyclictest0-21swapper/109:36:051
1918599130,12cyclictest0-21swapper/109:18:041
1918599130,12cyclictest0-21swapper/107:10:241
19184991310,2cyclictest3091-21diskmemload11:21:380
19184991310,2cyclictest0-21swapper/012:30:280
19184991310,2cyclictest0-21swapper/011:35:130
19184991310,2cyclictest0-21swapper/009:32:010
1918499130,6cyclictest0-21swapper/007:37:580
1918499130,2cyclictest0-21swapper/012:20:360
1918499130,2cyclictest0-21swapper/012:16:320
1918499130,2cyclictest0-21swapper/011:25:130
1918499130,2cyclictest0-21swapper/007:50:240
1918499130,12cyclictest0-21swapper/011:57:560
1918499130,12cyclictest0-21swapper/009:22:180
1918499130,11cyclictest11588-21ssh09:18:100
50422120,2sleep20-21swapper/209:10:292
1918899129,2cyclictest27479-21kworker/u8:007:35:043
1918899129,2cyclictest24018-21kworker/u8:107:55:043
1918899129,2cyclictest24018-21kworker/u8:107:30:043
1918899129,2cyclictest0-21swapper/310:33:553
1918899129,2cyclictest0-21swapper/307:20:273
1918899129,2cyclictest0-21swapper/307:20:263
1918899120,11cyclictest0-21swapper/308:15:203
1918799120,11cyclictest0-21swapper/207:25:152
1918599129,2cyclictest3091-21diskmemload10:46:461
1918599129,2cyclictest0-21swapper/112:36:001
1918599129,2cyclictest0-21swapper/111:05:261
1918599129,2cyclictest0-21swapper/110:00:141
1918599128,2cyclictest0-21swapper/107:15:171
1918599120,2cyclictest0-21swapper/111:40:421
1918599120,2cyclictest0-21swapper/108:20:161
1918599120,2cyclictest0-21swapper/108:05:261
1918599120,11cyclictest21848-21kworker/u8:211:16:051
1918599120,11cyclictest0-21swapper/109:45:171
1918599120,11cyclictest0-21swapper/107:45:151
1918499129,2cyclictest0-21swapper/010:05:340
1918499129,2cyclictest0-21swapper/008:50:000
1918499120,2cyclictest0-21swapper/010:00:260
1918499120,2cyclictest0-21swapper/008:10:000
1918499120,2cyclictest0-21swapper/007:10:120
1918499120,11cyclictest3091-21diskmemload09:25:450
1918499120,11cyclictest0-21swapper/008:35:180
1918599118,2cyclictest0-21swapper/109:05:201
1918599118,2cyclictest0-21swapper/109:00:151
1918599111,8cyclictest31092-21apt-get07:37:021
1918599110,9cyclictest0-21swapper/108:40:271
1918599110,9cyclictest0-21swapper/107:40:151
1918599110,2cyclictest0-21swapper/108:35:201
1918599110,2cyclictest0-21swapper/107:30:181
1918499118,2cyclictest0-21swapper/007:55:170
1918499118,2cyclictest0-21swapper/007:30:150
1918499112,8cyclictest0-21swapper/007:20:590
1918499112,8cyclictest0-21swapper/007:20:590
1918499112,6cyclictest0-21swapper/009:09:590
1918499110,10cyclictest0-21swapper/008:00:240
1918799101,5cyclictest0-21swapper/209:05:132
1918599107,2cyclictest0-21swapper/107:55:271
1918599103,6cyclictest0-21swapper/108:03:021
1918599102,5cyclictest0-21swapper/108:55:021
1918599101,6cyclictest0-21swapper/108:27:581
1918599100,2cyclictest0-21swapper/107:20:141
1918599100,2cyclictest0-21swapper/107:20:131
1918499102,7cyclictest0-21swapper/008:18:010
1918499102,6cyclictest0-21swapper/008:30:260
1918499102,6cyclictest0-21swapper/007:42:590
1918499102,5cyclictest0-21swapper/008:45:590
1918499102,5cyclictest0-21swapper/007:26:580
1918499100,7cyclictest0-21swapper/007:46:590
191859990,2cyclictest19649-21munin-node1
191849990,8cyclictest0-21swapper/008:06:590
191849980,7cyclictest0-21swapper/009:00:090
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional