You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-05-23 - 20:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot5s.osadl.org (updated Thu May 23, 2024 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4133992625,1cyclictest31453-21diskmemload12:20:530
4143992524,1cyclictest31453-21diskmemload10:37:313
414399250,24cyclictest0-21swapper/310:10:003
413999250,24cyclictest0-21swapper/209:51:402
413799250,24cyclictest0-21swapper/111:10:351
4133992523,2cyclictest0-21swapper/010:55:340
413399250,25cyclictest0-21swapper/010:00:410
413399250,24cyclictest19807-21sh11:48:260
413399250,24cyclictest19807-21sh11:48:260
413399250,24cyclictest0-21swapper/012:25:130
414399240,23cyclictest31453-21diskmemload09:47:413
414399240,23cyclictest12521-21apt-get12:15:333
414399240,23cyclictest0-21swapper/309:39:543
414399240,22cyclictest587-21irqbalance09:27:083
413999242,21cyclictest603-21in:imuxsock12:30:012
4139992422,1cyclictest3475-21munin-run08:15:002
413999241,22cyclictest2521-21munin-run12:40:002
413999240,23cyclictest31453-21diskmemload11:18:502
413999240,23cyclictest31453-21diskmemload10:17:482
413999240,23cyclictest0-21swapper/209:26:282
413999240,0cyclictest0-21swapper/210:23:342
413999240,0cyclictest0-21swapper/209:35:172
4137992424,0cyclictest31453-21diskmemload09:39:131
4137992423,1cyclictest23822-21munin-plugin-st07:50:001
413799240,24cyclictest31453-21diskmemload09:18:571
413799240,24cyclictest0-21swapper/112:39:231
413799240,24cyclictest0-21swapper/110:06:461
413799240,23cyclictest6795-21awk11:00:001
413799240,23cyclictest21134-21sh11:15:071
413799240,0cyclictest0-21swapper/110:15:371
4133992423,0cyclictest0-21swapper/011:41:000
4133992422,2cyclictest0-21swapper/010:45:340
413399242,21cyclictest3176-21ssh09:13:360
413399242,1cyclictest29072-21ssh11:57:560
4133992420,3cyclictest597-21dbus-daemon10:00:000
413399240,24cyclictest31453-21diskmemload09:47:510
413399240,24cyclictest0-21swapper/011:26:580
413399240,24cyclictest0-21swapper/010:19:350
413399240,23cyclictest31453-21diskmemload12:04:450
413399240,23cyclictest23751-21ssh09:34:500
413399240,0cyclictest0-21swapper/011:31:130
413399240,0cyclictest0-21swapper/011:01:580
4143992323,0cyclictest31453-21diskmemload11:50:423
4143992323,0cyclictest0-21swapper/312:14:293
4143992323,0cyclictest0-21swapper/309:30:093
4143992322,1cyclictest31453-21diskmemload12:20:093
4143992321,1cyclictest24494-21sh11:18:143
414399230,23cyclictest0-21swapper/312:26:583
414399230,23cyclictest0-21swapper/312:00:293
414399230,23cyclictest0-21swapper/309:18:543
414399230,22cyclictest2966-21df10:20:353
414399230,22cyclictest28700-21sh12:32:013
414399230,22cyclictest28092-21ssh10:11:543
414399230,22cyclictest0-21swapper/309:55:373
414399230,1cyclictest5827-21sh12:07:463
414399230,1cyclictest31453-21diskmemload11:07:323
414399230,0cyclictest0-21swapper/310:57:113
414399230,0cyclictest0-21swapper/309:10:303
4139992323,0cyclictest31453-21diskmemload11:03:292
4139992323,0cyclictest31453-21diskmemload10:11:152
4139992323,0cyclictest0-21swapper/211:20:252
4139992323,0cyclictest0-21swapper/209:30:592
4139992322,1cyclictest31453-21diskmemload10:03:312
4139992321,1cyclictest19766-21apt-get08:45:322
4139992321,1cyclictest0-21swapper/211:10:452
4139992321,0cyclictest0-21swapper/210:48:092
4139992320,3cyclictest0-21swapper/209:23:412
4139992320,2cyclictest4647-21sh09:47:282
413999230,23cyclictest0-21swapper/211:39:562
413999230,23cyclictest0-21swapper/210:40:302
413999230,23cyclictest0-21swapper/210:28:052
413999230,23cyclictest0-21swapper/209:17:182
413999230,22cyclictest597-21dbus-daemon10:40:012
413999230,22cyclictest31521-21sh09:41:472
413999230,22cyclictest31453-21diskmemload12:32:142
413999230,22cyclictest0-21swapper/212:20:362
4137992323,0cyclictest31453-21diskmemload12:13:121
4137992323,0cyclictest0-21swapper/112:35:001
4137992323,0cyclictest0-21swapper/111:46:441
4137992323,0cyclictest0-21swapper/111:46:441
4137992323,0cyclictest0-21swapper/111:25:091
4137992323,0cyclictest0-21swapper/109:47:501
4137992323,0cyclictest0-21swapper/109:40:571
4137992323,0cyclictest0-21swapper/109:33:421
4137992321,1cyclictest16509-21munin-run07:35:001
413799230,23cyclictest31453-21diskmemload10:49:421
413799230,23cyclictest31453-21diskmemload10:27:501
413799230,23cyclictest0-21swapper/112:16:451
413799230,23cyclictest0-21swapper/112:01:281
413799230,22cyclictest7573-21wc09:50:431
413799230,22cyclictest5878-21apt-get08:20:041
413799230,22cyclictest32532-21ssh09:10:391
413799230,22cyclictest18618-21sh10:36:411
413799230,22cyclictest13161-21ssh09:23:591
413799230,22cyclictest0-21swapper/112:25:361
413799230,22cyclictest0-21swapper/112:10:011
413799230,22cyclictest0-21swapper/111:10:001
413799230,1cyclictest28854-21ssh11:57:311
413799230,1cyclictest0-21swapper/111:32:341
413799230,1cyclictest0-21swapper/110:14:251
413799230,0cyclictest0-21swapper/112:20:041
413799230,0cyclictest0-21swapper/111:00:451
413399233,0cyclictest9374-21apt-get08:25:370
4133992323,0cyclictest0-21swapper/012:32:090
4133992323,0cyclictest0-21swapper/011:53:310
4133992323,0cyclictest0-21swapper/010:20:140
4133992322,1cyclictest31453-21diskmemload12:06:330
4133992322,1cyclictest0-21swapper/012:10:280
4133992322,1cyclictest0-21swapper/009:16:270
4133992321,1cyclictest13474-21memory12:15:390
4133992321,1cyclictest0-21swapper/008:55:350
413399231,22cyclictest0-21swapper/011:05:190
413399231,22cyclictest0-21swapper/009:52:420
413399231,22cyclictest0-21swapper/009:40:390
413399231,0cyclictest0-21swapper/010:51:030
413399230,2cyclictest12907-21sh09:23:320
413399230,23cyclictest0-21swapper/009:35:270
413399230,23cyclictest0-21swapper/009:26:350
413399230,22cyclictest31453-21diskmemload10:10:560
413399230,22cyclictest31446-21cron09:10:000
413399230,22cyclictest24571-21sh11:18:230
4143992222,0cyclictest0-21swapper/311:57:103
4143992222,0cyclictest0-21swapper/309:20:453
4143992220,1cyclictest2674-21sh11:30:193
4143992220,1cyclictest0-21swapper/308:25:013
414399220,22cyclictest0-21swapper/310:47:363
414399220,22cyclictest0-21swapper/307:20:353
414399220,21cyclictest7157-21ssh10:25:353
414399220,21cyclictest30299-21rm10:15:373
414399220,21cyclictest0-21swapper/312:35:353
414399220,21cyclictest0-21swapper/311:20:343
414399220,21cyclictest0-21swapper/309:40:163
414399220,21cyclictest0-21swapper/308:05:003
414399220,1cyclictest8893-21perf07:19:593
414399220,1cyclictest8693-21munin-run08:25:003
414399220,1cyclictest31453-21diskmemload11:03:243
414399220,1cyclictest19295-21ssh10:02:413
414399220,1cyclictest0-21swapper/309:50:163
414399220,0cyclictest0-21swapper/311:35:083
414399220,0cyclictest0-21swapper/311:13:013
4139992222,0cyclictest0-21swapper/212:00:182
4139992222,0cyclictest0-21swapper/210:52:592
4139992222,0cyclictest0-21swapper/208:05:372
4139992220,1cyclictest13694-21apt-get07:30:012
4139992220,1cyclictest0-21swapper/211:25:172
413999220,22cyclictest0-21swapper/211:40:082
413999220,21cyclictest31453-21diskmemload11:51:402
413999220,21cyclictest2828-21apt-get11:30:352
413999220,21cyclictest0-21swapper/209:55:362
413999220,21cyclictest0-21swapper/208:15:332
413999220,21cyclictest0-21swapper/207:25:332
413999220,1cyclictest7639-21apt-get12:10:012
413999220,1cyclictest0-21swapper/212:06:522
413999220,0cyclictest0-21swapper/212:15:242
4137992222,0cyclictest0-21swapper/110:23:291
4137992220,1cyclictest19003-21idleruntime-cro07:40:001
4137992220,1cyclictest0-21swapper/108:55:001
413799220,22cyclictest0-21swapper/110:33:031
413799220,21cyclictest11310-21awk07:25:001
413799220,21cyclictest0-21swapper/111:42:111
413799220,1cyclictest21267-21apt-get11:50:021
413799220,1cyclictest16864-21ssh09:26:581
4133992222,0cyclictest0-21swapper/011:12:240
4133992222,0cyclictest0-21swapper/010:33:280
4133992221,1cyclictest62150irq/126-eno111:37:540
4133992221,1cyclictest31453-21diskmemload10:35:300
4133992221,1cyclictest0-21swapper/012:37:560
4133992221,0cyclictest0-21swapper/009:00:360
4133992220,1cyclictest0-21swapper/008:35:010
413399220,21cyclictest3760-21apt-get08:15:330
413399220,21cyclictest16796-21apt-get07:35:340
413399220,21cyclictest0-21swapper/010:25:350
413399220,21cyclictest0-21swapper/010:05:480
413399220,1cyclictest0-21swapper/008:50:330
413399220,0cyclictest0-21swapper/008:00:340
4143992121,0cyclictest0-21swapper/310:50:323
4143992119,1cyclictest26627-21cron08:59:593
4143992119,1cyclictest24276-21perf08:55:003
4143992118,2cyclictest23806-21latency_hist07:50:003
414399210,21cyclictest0-21swapper/311:25:043
414399210,21cyclictest0-21swapper/310:43:113
414399210,0cyclictest0-21swapper/311:48:273
414399210,0cyclictest0-21swapper/311:48:273
414399210,0cyclictest0-21swapper/310:30:033
4139992121,0cyclictest0-21swapper/207:45:362
4139992121,0cyclictest0-21swapper/207:40:312
4139992120,1cyclictest29378-21apt-get09:05:342
4139992120,0cyclictest14552-21apt-get08:35:332
4139992119,1cyclictest0-21swapper/210:30:222
413999210,21cyclictest0-21swapper/211:49:032
413999210,21cyclictest0-21swapper/211:49:032
413999210,20cyclictest24107-21apt-get07:50:332
413999210,20cyclictest0-21swapper/211:55:342
413999210,0cyclictest19010-21perf07:40:002
413999210,0cyclictest0-21swapper/211:09:322
413999210,0cyclictest0-21swapper/210:57:122
4137992121,0cyclictest0-21swapper/110:00:131
4137992121,0cyclictest0-21swapper/108:20:001
4137992119,1cyclictest26979-21apt-get09:00:361
413799210,21cyclictest0-21swapper/111:20:161
413799210,21cyclictest0-21swapper/108:45:331
413799210,0cyclictest6791-21apt-get07:15:331
413799210,0cyclictest20939-21apt-get10:40:361
413799210,0cyclictest0-21swapper/111:35:141
413799210,0cyclictest0-21swapper/110:50:371
4133992120,1cyclictest0-21swapper/010:40:180
4133992117,3cyclictest3666-21cut08:15:000
413399210,21cyclictest0-21swapper/011:20:080
413399210,20cyclictest0-21swapper/008:35:330
4143992020,0cyclictest11602-21apt-get07:25:343
4143992020,0cyclictest0-21swapper/308:05:363
4143992020,0cyclictest0-21swapper/307:50:333
4143992017,2cyclictest16676-21sleep08:40:003
414399200,0cyclictest0-21swapper/307:40:313
413999200,20cyclictest0-21swapper/208:30:012
413999200,0cyclictest0-21swapper/208:40:332
4137992020,0cyclictest0-21swapper/108:40:331
4137992020,0cyclictest0-21swapper/108:10:321
4137992020,0cyclictest0-21swapper/107:50:341
4137992020,0cyclictest0-21swapper/107:40:311
413799200,20cyclictest0-21swapper/108:25:361
413799200,0cyclictest0-21swapper/107:10:321
4133992018,1cyclictest19766-21apt-get08:45:320
4133992017,2cyclictest0-21swapper/007:40:450
4133992016,3cyclictest7320-21fschecks_time07:15:370
4143991919,0cyclictest0-21swapper/309:05:343
4143991919,0cyclictest0-21swapper/308:45:323
4143991919,0cyclictest0-21swapper/308:30:013
4139991919,0cyclictest24559-21apt-get08:55:352
413999190,0cyclictest0-21swapper/209:00:372
4137991919,0cyclictest0-21swapper/108:55:351
4137991919,0cyclictest0-21swapper/108:05:371
4137991918,1cyclictest0-21swapper/107:30:001
4133991919,0cyclictest31328-21apt-get08:05:370
4133991919,0cyclictest0-21swapper/007:20:350
4133991919,0cyclictest0-21swapper/007:10:320
4133991916,2cyclictest0-21swapper/007:50:510
4143991818,0cyclictest0-21swapper/307:10:323
4133991817,0cyclictest26508-21apt-get07:55:350
4143991717,0cyclictest16970-21apt-get08:40:343
4143991717,0cyclictest0-21swapper/307:30:363
4139991717,0cyclictest4393-21apt-get07:10:322
4139991717,0cyclictest0-21swapper/208:50:332
4139991717,0cyclictest0-21swapper/208:25:362
413999171,14cyclictest26822-21avahi-daemon07:57:492
4137991717,0cyclictest0-21swapper/109:05:341
4137991717,0cyclictest0-21swapper/108:35:331
4133991717,0cyclictest0-21swapper/008:20:330
4139991616,0cyclictest0-21swapper/207:15:332
4139991614,1cyclictest0-21swapper/208:05:012
413799160,5cyclictest0-21swapper/108:00:341
413399164,11cyclictest0-21swapper/007:30:450
4139991515,0cyclictest0-21swapper/208:20:042
4139991515,0cyclictest0-21swapper/207:20:362
4133991515,0cyclictest0-21swapper/007:25:500
413399150,15cyclictest0-21swapper/007:47:060
414399140,14cyclictest0-21swapper/308:16:353
414399140,14cyclictest0-21swapper/308:10:213
414399140,14cyclictest0-21swapper/307:55:113
414399140,14cyclictest0-21swapper/307:37:303
414399140,0cyclictest0-21swapper/309:00:323
413799140,0cyclictest0-21swapper/107:55:041
413399140,0cyclictest0-21swapper/008:40:070
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional