You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-10-04 - 00:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Thu Oct 03, 2024 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30674211087,18sleep00-21swapper/007:05:540
30888210992,12sleep20-21swapper/207:08:412
29257210985,16sleep10-21swapper/107:05:121
30667210683,18sleep30-21swapper/307:05:503
236542780,0sleep30-21swapper/309:18:373
134902660,0sleep10-21swapper/109:40:371
219742570,0sleep30-21swapper/312:38:003
263242240,1sleep1221ktimersoftd/109:55:111
31017992116,3cyclictest4699-21kworker/u8:111:42:041
3101999200,2cyclictest0-21swapper/211:50:112
31017992017,2cyclictest19440-21kworker/u8:008:18:041
31017992017,2cyclictest13470-21kworker/u8:009:09:031
31020991916,2cyclictest4856-21kworker/u8:209:45:053
31020991916,2cyclictest11302-21kworker/u8:112:07:053
3101999190,2cyclictest0-21swapper/212:10:122
31017991916,2cyclictest4856-21kworker/u8:209:52:051
31017991916,2cyclictest2996-21kworker/u8:207:34:041
31017991916,2cyclictest24969-21kworker/u8:211:05:051
31017991916,2cyclictest23264-21kworker/u8:007:19:031
31017991916,2cyclictest11302-21kworker/u8:112:36:041
3101799191,2cyclictest0-21swapper/109:45:051
3101799190,17cyclictest0-21swapper/110:47:041
31017991815,2cyclictest4699-21kworker/u8:111:22:041
31017991815,2cyclictest3456-21kworker/u8:110:41:051
31017991815,2cyclictest2996-21kworker/u8:207:26:051
31017991815,2cyclictest29468-21kworker/u8:108:55:051
31017991815,2cyclictest29423-21kworker/u8:210:37:041
31017991815,2cyclictest24755-21kworker/u8:012:09:041
31017991815,2cyclictest2115-21kworker/u8:010:57:041
31017991815,2cyclictest2115-21kworker/u8:010:22:041
31017991815,2cyclictest19440-21kworker/u8:008:24:051
31017991815,2cyclictest15890-21kworker/u8:110:27:041
31017991815,2cyclictest11302-21kworker/u8:112:13:031
3101799180,16cyclictest0-21swapper/110:00:061
31020991714,2cyclictest9436-21kworker/u8:209:11:053
31020991714,2cyclictest29892-21kworker/u8:212:27:053
31020991714,2cyclictest24910-21kworker/u8:209:21:043
31020991714,2cyclictest20956-21kworker/u8:011:37:043
31020991714,2cyclictest12163-21kworker/u8:210:47:053
31020991714,2cyclictest12003-21kworker/u8:009:51:043
3101999171,14cyclictest31487-21apt-get08:30:112
31017991714,2cyclictest9436-21kworker/u8:209:02:041
31017991714,2cyclictest4699-21kworker/u8:111:31:041
31017991714,2cyclictest29423-21kworker/u8:210:33:041
31017991714,2cyclictest29047-21kworker/u8:110:10:041
31017991714,2cyclictest29047-21kworker/u8:110:05:051
31017991714,2cyclictest23264-21kworker/u8:007:20:041
31017991714,2cyclictest18377-21kworker/u8:109:29:041
31017991714,2cyclictest15156-21kworker/u8:108:05:041
31017991714,2cyclictest13470-21kworker/u8:009:19:051
31017991714,2cyclictest11299-21kworker/u8:211:28:031
3101799170,2cyclictest0-21swapper/109:11:051
31020991613,2cyclictest29047-21kworker/u8:110:00:063
31017991613,2cyclictest30975-21kworker/u8:011:10:051
31017991613,2cyclictest18377-21kworker/u8:109:23:051
3101799161,2cyclictest0-21swapper/111:37:041
3101699161,13cyclictest18689-21apt-get07:56:370
3101699160,14cyclictest0-21swapper/012:12:060
3101699160,14cyclictest0-21swapper/011:40:170
3101699160,14cyclictest0-21swapper/007:10:180
295382160,1sleep30-21swapper/310:30:573
31020991512,2cyclictest9052-21kworker/u8:210:12:053
31020991512,2cyclictest23264-21kworker/u8:007:10:053
31020991512,2cyclictest2115-21kworker/u8:010:08:043
31020991510,3cyclictest13476-21ssh09:40:343
3102099150,2cyclictest0-21swapper/309:38:003
3101999150,13cyclictest0-21swapper/209:30:412
3101799151,3cyclictest0-21swapper/110:19:041
31017991512,2cyclictest23264-21kworker/u8:007:42:041
3101799151,12cyclictest0-21swapper/111:15:061
31016991512,2cyclictest0-21swapper/009:46:080
3101699151,12cyclictest10016-21ssh10:10:340
3101699151,12cyclictest0-21swapper/010:37:480
3101699150,13cyclictest0-21swapper/010:56:080
3101699150,13cyclictest0-21swapper/010:48:440
3101699150,13cyclictest0-21swapper/010:30:120
3101699150,13cyclictest0-21swapper/009:15:380
31020991411,2cyclictest4699-21kworker/u8:111:21:043
31020991411,2cyclictest29892-21kworker/u8:212:32:043
31020991411,2cyclictest29892-21kworker/u8:212:22:043
31020991411,2cyclictest29468-21kworker/u8:108:54:043
31020991411,2cyclictest29468-21kworker/u8:108:48:033
31020991411,2cyclictest2115-21kworker/u8:010:56:033
31020991411,2cyclictest12163-21kworker/u8:210:51:053
31020991411,2cyclictest12003-21kworker/u8:009:55:053
31020991411,2cyclictest0-21swapper/307:50:153
31020991411,2cyclictest0-21swapper/307:35:153
31020991410,2cyclictest0-21swapper/309:30:473
3102099140,2cyclictest0-21swapper/310:22:103
3102099140,12cyclictest21153-21ssh12:03:503
3102099140,12cyclictest15099-21diskmemload12:12:003
3102099140,12cyclictest0-21swapper/312:15:563
3102099140,12cyclictest0-21swapper/311:54:183
3102099140,12cyclictest0-21swapper/311:06:413
3102099140,12cyclictest0-21swapper/308:10:153
31019991411,2cyclictest0-21swapper/211:31:192
3101999140,12cyclictest5893-21open_files07:25:172
3101999140,12cyclictest15099-21diskmemload11:26:502
3101999140,12cyclictest15099-21diskmemload10:46:212
3101999140,12cyclictest0-21swapper/212:39:302
3101999140,12cyclictest0-21swapper/211:36:302
3101999140,12cyclictest0-21swapper/210:30:272
3101799141,2cyclictest0-21swapper/111:52:171
31017991411,2cyclictest2996-21kworker/u8:207:49:051
31017991411,2cyclictest29892-21kworker/u8:212:31:051
31017991411,2cyclictest29468-21kworker/u8:108:46:041
31017991411,2cyclictest23141-21kworker/u8:208:10:041
31017991410,2cyclictest13729-21cut11:55:221
3101799140,2cyclictest0-21swapper/110:51:051
3101799140,2cyclictest0-21swapper/109:38:051
3101799140,2cyclictest0-21swapper/109:32:041
3101799140,2cyclictest0-21swapper/108:54:051
3101799140,2cyclictest0-21swapper/107:10:051
3101799140,13cyclictest0-21swapper/111:01:591
3101799140,13cyclictest0-21swapper/107:36:051
3101799140,12cyclictest0-21swapper/112:04:041
3101799140,12cyclictest0-21swapper/108:00:201
3101699149,3cyclictest0-21swapper/012:25:160
3101699141,3cyclictest20478-21ssh12:35:400
3101699141,2cyclictest11492-21ssh11:53:480
31016991411,2cyclictest0-21swapper/011:11:160
31016991411,2cyclictest0-21swapper/010:50:380
31016991411,2cyclictest0-21swapper/010:19:380
31016991410,2cyclictest25427-21perl09:20:140
3101699140,2cyclictest0-21swapper/011:19:100
3101699140,2cyclictest0-21swapper/009:12:180
3101699140,13cyclictest0-21swapper/010:04:380
3101699140,13cyclictest0-21swapper/009:52:180
3101699140,13cyclictest0-21swapper/009:27:080
3101699140,12cyclictest19291-21cat10:20:250
3101699140,12cyclictest0-21swapper/012:16:570
3101699140,12cyclictest0-21swapper/011:46:160
3101699140,12cyclictest0-21swapper/007:20:120
32432130,2sleep10-21swapper/112:19:031
31020991310,2cyclictest9436-21kworker/u8:209:05:053
31020991310,2cyclictest9436-21kworker/u8:209:01:053
31020991310,2cyclictest2996-21kworker/u8:207:25:033
31020991310,2cyclictest2115-21kworker/u8:010:40:033
31020991310,2cyclictest15156-21kworker/u8:108:03:043
31020991310,2cyclictest11299-21kworker/u8:211:30:033
31020991310,2cyclictest11299-21kworker/u8:211:26:043
31020991310,2cyclictest0-21swapper/310:15:423
3102099130,2cyclictest0-21swapper/311:47:203
3102099130,2cyclictest0-21swapper/311:17:133
3102099130,2cyclictest0-21swapper/311:12:453
3102099130,2cyclictest0-21swapper/311:00:133
3102099130,2cyclictest0-21swapper/307:56:333
3102099130,2cyclictest0-21swapper/307:30:163
3102099130,12cyclictest0-21swapper/311:55:303
3102099130,12cyclictest0-21swapper/309:25:033
3102099130,11cyclictest0-21swapper/310:25:053
31019991310,2cyclictest15099-21diskmemload10:40:452
31019991310,2cyclictest0-21swapper/211:13:452
31019991310,2cyclictest0-21swapper/210:56:592
31019991310,2cyclictest0-21swapper/210:12:402
31019991310,2cyclictest0-21swapper/210:06:292
31019991310,2cyclictest0-21swapper/209:44:122
31019991310,2cyclictest0-21swapper/209:22:312
31019991310,2cyclictest0-21swapper/209:11:112
31019991310,2cyclictest0-21swapper/208:45:122
3101999130,2cyclictest0-21swapper/210:25:572
3101999130,2cyclictest0-21swapper/209:50:192
3101999130,2cyclictest0-21swapper/209:15:112
3101999130,2cyclictest0-21swapper/207:55:152
3101999130,12cyclictest9068-21ssh12:25:062
3101999130,12cyclictest0-21swapper/212:02:202
3101999130,12cyclictest0-21swapper/211:18:252
3101999130,11cyclictest31827-21sh09:26:262
3101999130,11cyclictest15099-21diskmemload10:01:362
3101999130,11cyclictest0-21swapper/212:05:142
3101999130,11cyclictest0-21swapper/211:57:322
31017991310,2cyclictest0-21swapper/111:47:381
3101799130,2cyclictest0-21swapper/112:21:511
3101799130,11cyclictest0-21swapper/107:55:221
31016991310,2cyclictest15099-21diskmemload12:33:210
31016991310,2cyclictest0-21swapper/012:06:450
31016991310,2cyclictest0-21swapper/011:56:510
31016991310,2cyclictest0-21swapper/011:37:260
31016991310,2cyclictest0-21swapper/011:29:440
31016991310,2cyclictest0-21swapper/011:06:480
31016991310,2cyclictest0-21swapper/009:57:190
31016991310,2cyclictest0-21swapper/009:37:070
3101699130,3cyclictest0-21swapper/011:23:380
3101699130,3cyclictest0-21swapper/009:32:040
3101699130,2cyclictest15099-21diskmemload10:06:460
3101699130,2cyclictest0-21swapper/011:30:100
3101699130,2cyclictest0-21swapper/010:43:130
3101699130,1cyclictest0-21swapper/007:40:170
3101699130,12cyclictest0-21swapper/010:26:080
3101699130,12cyclictest0-21swapper/008:55:170
266212130,2sleep00-21swapper/011:01:380
3102099129,2cyclictest2996-21kworker/u8:207:22:053
3102099129,2cyclictest29468-21kworker/u8:108:37:053
3102099129,2cyclictest29468-21kworker/u8:108:30:043
3102099129,2cyclictest23264-21kworker/u8:007:40:053
3102099129,2cyclictest23141-21kworker/u8:208:15:053
3102099129,2cyclictest19440-21kworker/u8:008:21:053
3102099129,2cyclictest0-21swapper/310:35:013
3102099120,2cyclictest0-21swapper/311:40:233
3102099120,2cyclictest0-21swapper/307:15:193
3102099120,11cyclictest0-21swapper/308:25:253
3101999129,2cyclictest15099-21diskmemload09:55:322
3101999129,2cyclictest0-21swapper/212:20:092
3101999129,2cyclictest0-21swapper/210:35:212
3101999129,2cyclictest0-21swapper/210:15:102
3101999129,2cyclictest0-21swapper/209:05:152
3101999129,2cyclictest0-21swapper/208:55:142
3101999120,2cyclictest0-21swapper/212:31:492
3101999120,2cyclictest0-21swapper/210:20:092
3101999120,11cyclictest12955-21copy07:45:042
3101999120,11cyclictest0-21swapper/211:48:562
3101999120,11cyclictest0-21swapper/211:42:492
3101999120,11cyclictest0-21swapper/211:23:282
3101999120,11cyclictest0-21swapper/211:06:202
3101999120,11cyclictest0-21swapper/211:00:112
3101999120,11cyclictest0-21swapper/210:51:432
3101999120,11cyclictest0-21swapper/209:35:132
3101999120,11cyclictest0-21swapper/208:05:212
3101799121,9cyclictest0-21swapper/108:40:131
3101799121,3cyclictest31484-21munin-node1
3101799120,2cyclictest8857-21copy12:25:041
3101699129,2cyclictest0-21swapper/012:20:400
3101699129,2cyclictest0-21swapper/008:35:170
3101699129,2cyclictest0-21swapper/007:50:190
3101699129,2cyclictest0-21swapper/007:30:270
3101699120,1cyclictest0-21swapper/009:40:130
3101699120,11cyclictest0-21swapper/012:00:190
29082120,2sleep215099-21diskmemload12:18:322
268292120,2sleep00-21swapper/008:15:260
3102099110,10cyclictest0-21swapper/308:58:263
3101999118,2cyclictest0-21swapper/207:10:172
3101799110,9cyclictest29470-21munin-node1
3101699119,1cyclictest0-21swapper/008:25:000
3101699116,3cyclictest21774-21diskstats08:05:120
3101699111,8cyclictest0-21swapper/007:16:140
3101699110,10cyclictest29468-21kworker/u8:108:50:050
68782100,2sleep00-21swapper/008:48:030
3102099107,2cyclictest2996-21kworker/u8:207:48:053
3101999107,2cyclictest0-21swapper/209:00:182
3101999107,2cyclictest0-21swapper/208:25:122
3101999104,5cyclictest0-21swapper/207:54:042
3101999100,9cyclictest0-21swapper/209:47:562
3101999100,9cyclictest0-21swapper/208:40:152
3101999100,9cyclictest0-21swapper/208:15:232
3101799107,2cyclictest16490-21sed07:50:261
3101799100,9cyclictest0-21swapper/108:35:231
3101699107,2cyclictest0-21swapper/009:00:290
3101699107,2cyclictest0-21swapper/008:40:190
3101699106,2cyclictest277-21jbd2/sda1-807:45:140
3101699100,8cyclictest2996-21kworker/u8:207:35:050
3101699100,8cyclictest19440-21kworker/u8:008:20:050
310209990,8cyclictest0-21swapper/308:41:133
310199996,2cyclictest0-21swapper/207:15:132
310169996,2cyclictest0-21swapper/007:25:240
310169994,3cyclictest3745-21runrttasks08:13:520
310169994,3cyclictest31797-21df_abs08:30:120
310169994,3cyclictest208892sleep008:01:310
310209985,2cyclictest0-21swapper/308:05:013
310199985,2cyclictest0-21swapper/207:22:512
310199983,3cyclictest27486-21basename08:20:122
310199983,3cyclictest0-21swapper/207:30:202
310199980,2cyclictest0-21swapper/208:14:552
310199980,2cyclictest0-21swapper/208:00:362
310199980,2cyclictest0-21swapper/207:36:022
310169983,3cyclictest13299-21runrttasks09:05:050
12792280,1sleep20-21swapper/207:43:392
310199974,2cyclictest7698-21fschecks_count08:50:142
310199974,2cyclictest1445-21forks08:35:142
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional