You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-23 - 18:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Tue Apr 23, 2024 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2450210885,18sleep30-21swapper/307:09:483
2927821070,1sleep30-21swapper/308:15:133
2589421070,0sleep30-21swapper/310:26:383
2340210796,6sleep00-21swapper/007:08:200
2191210695,6sleep10-21swapper/107:06:241
2304210184,12sleep20-21swapper/207:07:532
236692730,1sleep323672-21aten2.4_r3power09:15:113
39442700,0sleep20-21swapper/212:24:142
134132660,1sleep10-21swapper/108:55:131
253562320,1sleep1221ktimersoftd/111:00:431
249699250,23cyclictest0-21swapper/007:39:350
249699250,23cyclictest0-21swapper/007:39:350
249899230,22cyclictest0-21swapper/211:51:032
249799220,2cyclictest0-21swapper/112:22:111
249699220,17cyclictest0-21swapper/010:24:050
249799210,3cyclictest23613-21munin-node1
249799210,3cyclictest0-21swapper/107:55:231
2498992017,2cyclictest22049-21kworker/u8:009:49:052
249899200,18cyclictest31-21ksoftirqd/209:22:052
249799200,2cyclictest0-21swapper/112:38:011
249799200,2cyclictest0-21swapper/110:50:111
249799200,2cyclictest0-21swapper/107:35:011
249799200,2cyclictest0-21swapper/107:35:011
249799200,18cyclictest0-21swapper/110:15:101
249799200,13cyclictest18731-21diskmemload12:31:401
249799200,13cyclictest14933-21apt-get07:40:061
249799200,13cyclictest14933-21apt-get07:40:061
249799200,12cyclictest0-21swapper/109:45:141
2498991916,2cyclictest6052-21kworker/u8:212:02:052
2498991916,2cyclictest26935-21kworker/u8:109:55:052
249799190,3cyclictest31128-21cat08:20:011
249799190,2cyclictest6769-21latency_hist08:40:001
249799190,2cyclictest21264-21sh12:07:001
249799190,2cyclictest19937-21proc_pri11:30:211
249799190,2cyclictest16253-21ssh09:40:491
249799190,2cyclictest0-21swapper/112:00:171
249799190,2cyclictest0-21swapper/111:55:031
249799190,2cyclictest0-21swapper/111:39:531
249799190,2cyclictest0-21swapper/111:25:291
249799190,2cyclictest0-21swapper/111:15:121
249799190,2cyclictest0-21swapper/111:10:291
249799190,2cyclictest0-21swapper/111:05:211
249799190,2cyclictest0-21swapper/110:40:171
249799190,2cyclictest0-21swapper/110:31:251
249799190,2cyclictest0-21swapper/110:22:451
249799190,2cyclictest0-21swapper/110:12:051
249799190,2cyclictest0-21swapper/110:07:131
249799190,2cyclictest0-21swapper/109:38:401
249799190,2cyclictest0-21swapper/109:12:561
249799190,2cyclictest0-21swapper/109:05:131
249799190,2cyclictest0-21swapper/108:50:291
249799190,2cyclictest0-21swapper/108:45:011
249799190,2cyclictest0-21swapper/108:10:161
249799190,2cyclictest0-21swapper/107:15:131
249799190,1cyclictest0-21swapper/111:22:131
249799190,18cyclictest0-21swapper/111:42:301
249799190,17cyclictest0-21swapper/112:10:441
249799190,17cyclictest0-21swapper/110:00:481
101842190,1sleep2301ktimersoftd/207:25:282
249999180,16cyclictest0-21swapper/310:05:123
2498991815,2cyclictest23824-21kworker/u8:011:08:052
2498991815,2cyclictest16227-21kworker/u8:310:01:042
2498991815,2cyclictest12695-21kworker/u8:107:59:042
249899180,16cyclictest0-21swapper/212:26:052
249799180,2cyclictest18731-21diskmemload10:35:051
249799180,2cyclictest0-21swapper/112:25:051
249799180,2cyclictest0-21swapper/112:15:201
249799180,2cyclictest0-21swapper/111:50:091
249799180,2cyclictest0-21swapper/111:45:211
249799180,2cyclictest0-21swapper/110:55:571
249799180,2cyclictest0-21swapper/110:45:051
249799180,2cyclictest0-21swapper/110:25:321
249799180,2cyclictest0-21swapper/109:55:251
249799180,2cyclictest0-21swapper/109:30:131
249799180,2cyclictest0-21swapper/109:25:121
249799180,2cyclictest0-21swapper/109:20:251
249799180,2cyclictest0-21swapper/109:15:011
249799180,2cyclictest0-21swapper/108:45:091
249799180,2cyclictest0-21swapper/108:32:171
249799180,2cyclictest0-21swapper/108:30:011
249799180,2cyclictest0-21swapper/108:24:131
249799180,2cyclictest0-21swapper/108:07:211
249799180,2cyclictest0-21swapper/108:05:011
249699181,15cyclictest5878-21metacity10:38:590
304512174,2sleep018731-21diskmemload09:21:220
2498991714,2cyclictest21919-21kworker/u8:110:23:042
249799170,2cyclictest14956-21apt-get09:00:121
249799170,2cyclictest0-21swapper/107:50:131
249799170,2cyclictest0-21swapper/107:45:001
249799170,2cyclictest0-21swapper/107:30:001
249799170,2cyclictest0-21swapper/107:25:011
249799170,2cyclictest0-21swapper/107:23:411
249799170,2cyclictest0-21swapper/107:10:571
323192160,0sleep20-21swapper/208:20:242
292732160,0sleep20-21swapper/212:15:272
249999160,14cyclictest0-21swapper/312:05:143
2498991613,2cyclictest32118-21kworker/u8:211:15:042
2498991613,2cyclictest32118-21kworker/u8:211:12:052
2498991613,2cyclictest23824-21kworker/u8:011:04:042
2498991613,2cyclictest14125-21kworker/u8:111:35:052
249899161,13cyclictest20187-21sort12:05:272
249899160,14cyclictest0-21swapper/212:35:552
249899160,14cyclictest0-21swapper/210:14:352
249699161,13cyclictest0-21swapper/010:47:160
249999151,2cyclictest27971-21apt-get12:15:113
249999151,12cyclictest4797-21ssh11:50:063
249999150,13cyclictest5598-21df_abs09:30:133
249999150,13cyclictest0-21swapper/308:50:283
2498991512,2cyclictest25917-21kworker/u8:212:14:052
2498991512,2cyclictest22049-21kworker/u8:009:52:052
2498991512,2cyclictest18245-21kworker/u8:207:34:032
249899150,13cyclictest0-21swapper/207:10:152
249699150,13cyclictest0-21swapper/012:21:310
44562140,3sleep24467-21sh11:49:562
2499991411,2cyclictest0-21swapper/309:55:443
249999140,2cyclictest18731-21diskmemload11:00:233
249999140,12cyclictest18731-21diskmemload10:10:043
249999140,12cyclictest18731-21diskmemload10:00:093
249999140,12cyclictest17998-21ssh09:43:443
249999140,12cyclictest0-21swapper/310:59:113
249999140,12cyclictest0-21swapper/310:43:293
249999140,12cyclictest0-21swapper/307:50:273
2498991411,2cyclictest301ktimersoftd/209:26:052
2498991411,2cyclictest25992-21kworker/u8:009:30:052
2498991411,2cyclictest24688-21kworker/u8:008:07:052
2498991411,2cyclictest18389-21kworker/u8:109:10:042
2498991411,2cyclictest13647-21kworker/u8:211:31:042
249899140,9cyclictest0-21swapper/210:31:052
249899140,2cyclictest0-21swapper/212:31:452
249899140,2cyclictest0-21swapper/210:58:342
249899140,2cyclictest0-21swapper/210:17:052
249899140,2cyclictest0-21swapper/210:09:252
249899140,12cyclictest0-21swapper/210:40:352
249899140,12cyclictest0-21swapper/209:15:022
249899140,12cyclictest0-21swapper/207:35:252
249899140,12cyclictest0-21swapper/207:35:252
249699149,3cyclictest5074-21kworker/u8:011:24:050
249699144,5cyclictest0-21swapper/011:09:030
2496991411,2cyclictest0-21swapper/009:05:310
2496991411,2cyclictest0-21swapper/008:10:100
2496991411,2cyclictest0-21swapper/007:20:200
249699140,2cyclictest17186-21munin-node0
249699140,2cyclictest0-21swapper/010:30:140
249699140,2cyclictest0-21swapper/009:43:010
249699140,2cyclictest0-21swapper/008:45:210
249699140,13cyclictest0-21swapper/010:40:300
249699140,13cyclictest0-21swapper/010:05:410
249699140,13cyclictest0-21swapper/009:35:210
249699140,13cyclictest0-21swapper/009:33:310
249699140,12cyclictest25917-21kworker/u8:212:16:050
249699140,12cyclictest10361-21kworker/u8:007:40:040
249699140,12cyclictest10361-21kworker/u8:007:40:030
249699140,12cyclictest0-21swapper/012:35:140
218862140,4sleep0249699cyclictest07:55:150
156952140,1sleep30-21swapper/310:15:283
249999138,3cyclictest32509-21apt-get10:35:043
249999138,3cyclictest23630-21rm09:50:103
249999138,3cyclictest13906-21runrttasks09:39:363
2499991310,2cyclictest0-21swapper/312:35:193
2499991310,2cyclictest0-21swapper/312:31:443
2499991310,2cyclictest0-21swapper/312:24:503
2499991310,2cyclictest0-21swapper/312:01:043
2499991310,2cyclictest0-21swapper/311:49:053
2499991310,2cyclictest0-21swapper/311:40:503
2499991310,2cyclictest0-21swapper/311:32:573
2499991310,2cyclictest0-21swapper/311:28:383
2499991310,2cyclictest0-21swapper/311:17:103
2499991310,2cyclictest0-21swapper/311:10:403
2499991310,2cyclictest0-21swapper/309:48:093
2499991310,2cyclictest0-21swapper/309:25:233
2499991310,2cyclictest0-21swapper/309:00:183
249999130,2cyclictest18731-21diskmemload09:20:183
249999130,2cyclictest0-21swapper/311:05:303
249999130,2cyclictest0-21swapper/307:15:103
249999130,12cyclictest0-21swapper/312:28:573
249999130,12cyclictest0-21swapper/312:10:433
249999130,12cyclictest0-21swapper/311:36:243
249999130,12cyclictest0-21swapper/308:40:163
249999130,11cyclictest18731-21diskmemload09:10:363
249899138,3cyclictest0-21swapper/211:55:132
249899138,3cyclictest0-21swapper/208:00:222
249899134,7cyclictest0-21swapper/209:05:022
249899132,3cyclictest15622-21cat11:25:272
2498991310,2cyclictest7862-21kworker/u8:210:52:042
2498991310,2cyclictest7016-21kworker/u8:209:03:052
2498991310,2cyclictest3063-21kworker/u8:108:33:052
2498991310,2cyclictest28659-21kworker/u8:208:15:052
2498991310,2cyclictest0-21swapper/209:35:192
2498991310,2cyclictest0-21swapper/207:50:272
249899130,2cyclictest18731-21diskmemload10:38:412
249899130,2cyclictest0-21swapper/211:40:202
249899130,2cyclictest0-21swapper/210:25:172
249899130,11cyclictest0-21swapper/211:20:072
249899130,11cyclictest0-21swapper/208:10:252
2496991310,2cyclictest0-21swapper/012:32:200
2496991310,2cyclictest0-21swapper/012:13:310
2496991310,2cyclictest0-21swapper/011:49:220
2496991310,2cyclictest0-21swapper/011:31:200
2496991310,2cyclictest0-21swapper/009:19:210
249699130,2cyclictest10708-21ssh11:55:250
249699130,2cyclictest0-21swapper/011:19:020
249699130,2cyclictest0-21swapper/010:55:510
249699130,2cyclictest0-21swapper/010:50:110
249699130,2cyclictest0-21swapper/010:25:150
249699130,12cyclictest14125-21kworker/u8:111:01:050
249699130,12cyclictest0-21swapper/009:49:450
249699130,11cyclictest4559-21copy12:25:030
249699130,11cyclictest0-21swapper/011:50:270
249699130,11cyclictest0-21swapper/009:50:380
234352130,2sleep018731-21diskmemload11:35:070
249999129,2cyclictest0-21swapper/310:52:103
249999129,2cyclictest0-21swapper/310:47:353
249999129,2cyclictest0-21swapper/308:35:153
249999129,2cyclictest0-21swapper/307:30:203
249999129,2cyclictest0-21swapper/307:10:203
249999120,2cyclictest0-21swapper/311:20:573
249999120,11cyclictest0-21swapper/311:55:153
249999120,11cyclictest0-21swapper/310:30:263
249999120,11cyclictest0-21swapper/310:20:293
249999120,11cyclictest0-21swapper/308:00:173
249899129,2cyclictest7016-21kworker/u8:208:56:052
249899129,2cyclictest18245-21kworker/u8:207:22:042
249899129,2cyclictest10361-21kworker/u8:007:45:042
249899127,3cyclictest10934-21munin-node2
249899127,3cyclictest0-21swapper/207:15:172
249899121,3cyclictest0-21swapper/208:25:222
249899120,2cyclictest0-21swapper/209:40:212
249899120,2cyclictest0-21swapper/208:45:102
249899120,2cyclictest0-21swapper/208:40:142
249899120,11cyclictest0-21swapper/210:46:172
249699129,2cyclictest0-21swapper/010:19:110
249699129,2cyclictest0-21swapper/008:55:090
249699129,2cyclictest0-21swapper/008:40:180
249699129,2cyclictest0-21swapper/008:25:010
249699129,2cyclictest0-21swapper/007:25:170
249699120,2cyclictest18731-21diskmemload11:28:460
249699120,2cyclictest0-21swapper/009:56:110
249699120,2cyclictest0-21swapper/009:26:020
249699120,2cyclictest0-21swapper/009:10:340
249699120,11cyclictest18731-21diskmemload10:00:120
249699120,11cyclictest0-21swapper/012:05:240
249699120,11cyclictest0-21swapper/012:04:410
249699120,11cyclictest0-21swapper/011:40:210
249699120,11cyclictest0-21swapper/011:12:170
249699120,11cyclictest0-21swapper/010:14:260
249999117,2cyclictest0-21swapper/309:05:143
249999116,3cyclictest25808-21cut08:05:153
249999116,3cyclictest18124-21wc07:45:213
249999112,6cyclictest0-21swapper/308:13:593
249999111,7cyclictest0-21swapper/308:34:023
249999110,9cyclictest0-21swapper/307:24:553
249999110,3cyclictest0-21swapper/308:29:143
249999110,10cyclictest0-21swapper/307:59:073
249899110,10cyclictest0-21swapper/208:39:042
249699118,2cyclictest0-21swapper/008:15:310
249699110,10cyclictest0-21swapper/009:00:200
249999107,2cyclictest0-21swapper/308:45:143
249999100,7cyclictest0-21swapper/307:29:023
249899100,2cyclictest14974-21copy07:40:042
249899100,2cyclictest14974-21copy07:40:042
249699107,2cyclictest0-21swapper/008:35:220
249699107,2cyclictest0-21swapper/007:15:240
249699104,2cyclictest0-21swapper/007:12:040
249699102,7cyclictest0-21swapper/008:30:590
249699100,9cyclictest7016-21kworker/u8:208:51:050
249699100,9cyclictest31375-21kworker/u8:008:25:040
24999996,2cyclictest12998-21apt-get07:35:133
24999996,2cyclictest12998-21apt-get07:35:123
24999994,3cyclictest5095-21runrttasks07:44:143
24999994,3cyclictest5095-21runrttasks07:44:143
24999994,3cyclictest460-21chrt08:24:133
24999994,3cyclictest13193-21cpuspeed_turbos08:55:123
24969990,7cyclictest0-21swapper/007:50:250
24969985,2cyclictest0-21swapper/008:00:180
24969983,4cyclictest0-21swapper/008:05:040
24969980,2cyclictest0-21swapper/007:30:020
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional