You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-02-10 - 23:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Mon Feb 10, 2025 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30495212095,18sleep00-21swapper/007:05:230
31070211497,12sleep30-21swapper/307:07:393
31038211495,14sleep10-21swapper/107:07:121
31136211194,12sleep20-21swapper/207:08:302
316162780,0sleep00-21swapper/008:29:590
234762670,0sleep00-21swapper/008:10:010
3128199220,20cyclictest0-21swapper/210:00:122
3128099221,19cyclictest0-21swapper/111:10:071
3128099221,19cyclictest0-21swapper/109:50:071
31279992217,3cyclictest8422-21nscd12:20:120
3127999221,19cyclictest0-21swapper/011:20:100
3127999221,12cyclictest22020-21ssh11:39:120
214732220,1sleep20-21swapper/209:15:182
79912210,1sleep231-21ksoftirqd/210:11:572
76672210,1sleep30-21swapper/310:47:573
326952210,1sleep2301ktimersoftd/211:15:142
3128299210,19cyclictest0-21swapper/309:00:113
3128299210,19cyclictest0-21swapper/307:35:013
3128199210,17cyclictest0-21swapper/210:36:042
31280992117,2cyclictest31405-21kworker/u8:211:03:031
3127999212,6cyclictest15387-21diskmemload10:10:000
3127999212,6cyclictest0-21swapper/008:10:000
31279992110,2cyclictest0-21swapper/008:40:130
31282992015,3cyclictest22613-21wc08:05:193
3128299200,19cyclictest0-21swapper/309:50:083
31281992017,2cyclictest949-21kworker/u8:211:54:042
31281992017,2cyclictest27462-21kworker/u8:209:25:042
31281992017,2cyclictest21166-21kworker/u8:208:04:042
3128199201,2cyclictest0-21swapper/210:45:042
3128199200,15cyclictest0-21swapper/209:37:032
31280992015,3cyclictest11019-21kworker/u8:011:52:041
3128099200,18cyclictest0-21swapper/107:35:001
3127999209,2cyclictest0-21swapper/010:37:220
3127999207,3cyclictest14891-21basename10:20:000
3127999201,11cyclictest15387-21diskmemload11:25:150
31281991916,2cyclictest8828-21kworker/u8:107:41:042
31281991916,2cyclictest31657-21kworker/u8:112:29:042
31281991916,2cyclictest26860-21kworker/u8:207:10:042
31281991916,2cyclictest23240-21kworker/u8:111:06:052
31281991916,2cyclictest16041-21kworker/u8:211:46:032
31281991916,2cyclictest0-21swapper/211:20:102
3128199190,2cyclictest0-21swapper/212:20:052
31280991915,2cyclictest6211-21kworker/u8:010:11:041
3127999199,2cyclictest11986-21ssh12:03:110
3127999196,3cyclictest0-21swapper/009:24:260
3127999191,6cyclictest0-21swapper/012:18:500
3127999190,11cyclictest15387-21diskmemload10:24:550
3127999190,11cyclictest0-21swapper/010:26:360
31281991815,2cyclictest949-21kworker/u8:211:56:052
31281991815,2cyclictest8828-21kworker/u8:108:19:042
31281991815,2cyclictest878-21kworker/u8:109:30:052
31281991815,2cyclictest3218-21kworker/u8:207:35:032
31281991815,2cyclictest31532-21kworker/u8:107:25:052
31281991815,2cyclictest31405-21kworker/u8:211:13:042
31281991815,2cyclictest31405-21kworker/u8:211:02:042
31281991815,2cyclictest31393-21kworker/u8:108:30:032
31281991815,2cyclictest31393-21kworker/u8:108:29:032
31281991815,2cyclictest21166-21kworker/u8:208:24:032
31281991815,2cyclictest18918-21kworker/u8:112:16:042
31281991815,2cyclictest11623-21kworker/u8:209:04:032
31281991815,2cyclictest11019-21kworker/u8:011:44:042
3128199181,2cyclictest23808-21kworker/2:211:26:042
3128199180,2cyclictest0-21swapper/209:20:032
3128099181,2cyclictest0-21swapper/109:15:111
3127999187,3cyclictest0-21swapper/011:04:270
3127999181,6cyclictest0-21swapper/010:53:330
3127999181,6cyclictest0-21swapper/007:47:570
3127999181,3cyclictest3124-21munin-run08:39:590
3127999180,10cyclictest15387-21diskmemload12:37:130
3127999180,10cyclictest15387-21diskmemload09:37:530
31281991714,2cyclictest3436-21kworker/u8:008:44:052
31281991714,2cyclictest31532-21kworker/u8:107:16:042
31281991714,2cyclictest31393-21kworker/u8:108:54:052
31281991714,2cyclictest31393-21kworker/u8:108:36:042
31281991714,2cyclictest21166-21kworker/u8:208:05:032
31280991710,5cyclictest4572-21gdm-simple-gree10:29:581
3127999179,2cyclictest30635-21ssh11:13:020
3127999179,2cyclictest0-21swapper/009:44:420
3127999172,7cyclictest0-21swapper/008:47:010
3127999170,6cyclictest0-21swapper/010:43:300
3127999170,11cyclictest0-21swapper/010:58:030
31281991613,2cyclictest7287-21kworker/u8:112:03:042
31281991613,2cyclictest31657-21kworker/u8:112:34:042
31281991613,2cyclictest31657-21kworker/u8:112:34:032
31281991613,2cyclictest12996-21kworker/u8:312:07:032
3128199160,7cyclictest0-21swapper/211:35:032
3128199160,2cyclictest0-21swapper/210:40:032
3128199160,2cyclictest0-21swapper/210:21:042
31280991613,2cyclictest6776-21kworker/u8:211:24:041
31280991613,2cyclictest2087-21kworker/u8:110:23:051
31280991613,2cyclictest16041-21kworker/u8:211:37:041
31280991613,2cyclictest15303-21kworker/u8:009:27:041
31280991612,2cyclictest203450irq/24-eth110:30:081
3127999162,7cyclictest8327-21ssh10:48:590
3127999162,5cyclictest0-21swapper/009:10:010
3127999161,6cyclictest0-21swapper/009:28:160
3127999161,5cyclictest0-21swapper/008:23:010
31279991611,3cyclictest14806-21runrttasks12:07:120
3128299150,4cyclictest0-21swapper/310:33:503
3128299150,13cyclictest0-21swapper/309:13:143
3128299150,13cyclictest0-21swapper/308:50:313
3128299150,13cyclictest0-21swapper/307:25:153
31281991512,2cyclictest6711-21kworker/u8:007:30:042
31281991512,2cyclictest15617-21kworker/u8:007:54:052
3128199150,2cyclictest0-21swapper/212:14:042
3128199150,2cyclictest0-21swapper/210:34:052
3128099152,7cyclictest0-21swapper/112:20:001
3128099152,7cyclictest0-21swapper/111:45:011
3128099151,3cyclictest10434-21munin-node1
31280991512,2cyclictest31532-21kworker/u8:107:19:041
31280991512,2cyclictest0-21swapper/109:44:051
3128099150,3cyclictest0-21swapper/110:18:041
3128099150,2cyclictest0-21swapper/111:42:041
3127999152,7cyclictest0-21swapper/007:50:000
3127999150,13cyclictest0-21swapper/010:11:420
69202140,2sleep30-21swapper/312:34:333
69202140,2sleep30-21swapper/312:34:323
3128299149,3cyclictest22780-21taskset09:16:323
31282991411,2cyclictest21349-21taskset08:03:503
3128299141,11cyclictest32261-21ssh10:02:243
3128299140,2cyclictest0-21swapper/309:42:313
3128299140,12cyclictest31657-21kworker/u8:112:38:043
3128299140,12cyclictest25456-21ssh09:20:123
3128299140,12cyclictest19269-21ssh10:24:163
3128299140,12cyclictest15387-21diskmemload12:22:453
3128299140,12cyclictest0-21swapper/312:06:403
3128299140,12cyclictest0-21swapper/311:50:593
3128299140,12cyclictest0-21swapper/311:33:163
3128299140,12cyclictest0-21swapper/310:06:153
3128299140,12cyclictest0-21swapper/309:58:023
3128299140,12cyclictest0-21swapper/309:30:183
3128299140,12cyclictest0-21swapper/307:40:113
31281991411,2cyclictest15303-21kworker/u8:009:09:052
3128199140,2cyclictest0-21swapper/212:39:042
3128199140,2cyclictest0-21swapper/210:28:302
3128199140,2cyclictest0-21swapper/210:07:052
3128199140,13cyclictest0-21swapper/207:58:042
3128199140,12cyclictest0-21swapper/210:55:482
3128099149,3cyclictest0-21swapper/110:47:441
3128099142,6cyclictest0-21swapper/109:50:001
3128099141,2cyclictest15387-21diskmemload10:58:081
31280991411,2cyclictest878-21kworker/u8:109:38:041
31280991411,2cyclictest29237-21kworker/u8:210:01:041
31280991411,2cyclictest21635-21kworker/u8:109:59:051
31280991411,2cyclictest0-21swapper/110:37:471
3128099140,2cyclictest15387-21diskmemload11:56:281
3128099140,12cyclictest15387-21diskmemload11:31:451
3128099140,12cyclictest0-21swapper/112:27:161
3128099140,12cyclictest0-21swapper/111:25:511
3128099140,12cyclictest0-21swapper/108:50:201
3127999142,7cyclictest0-21swapper/007:30:000
3127999141,11cyclictest0-21swapper/012:27:490
3128299139,2cyclictest0-21swapper/311:42:243
31282991310,2cyclictest0-21swapper/312:25:093
31282991310,2cyclictest0-21swapper/311:48:173
31282991310,2cyclictest0-21swapper/311:27:303
31282991310,2cyclictest0-21swapper/311:15:093
31282991310,2cyclictest0-21swapper/311:08:153
31282991310,2cyclictest0-21swapper/311:00:473
31282991310,2cyclictest0-21swapper/310:55:343
31282991310,2cyclictest0-21swapper/310:50:553
31282991310,2cyclictest0-21swapper/309:29:283
3128299130,2cyclictest15387-21diskmemload10:42:343
3128299130,2cyclictest0-21swapper/311:57:463
3128299130,2cyclictest0-21swapper/311:12:053
3128299130,2cyclictest0-21swapper/309:47:583
3128299130,2cyclictest0-21swapper/309:36:093
3128299130,12cyclictest0-21swapper/310:15:203
3128299130,12cyclictest0-21swapper/310:10:103
3128299130,12cyclictest0-21swapper/307:55:163
3128299130,11cyclictest15387-21diskmemload12:00:303
3128299130,11cyclictest0-21swapper/312:15:433
3128299130,11cyclictest0-21swapper/311:37:063
3128299130,11cyclictest0-21swapper/311:20:073
3128299130,11cyclictest0-21swapper/310:27:243
3128299130,11cyclictest0-21swapper/307:45:053
31281991310,2cyclictest0-21swapper/211:30:362
3128199130,2cyclictest0-21swapper/209:56:032
3128199130,2cyclictest0-21swapper/209:51:032
3128199130,2cyclictest0-21swapper/209:10:032
3128199130,2cyclictest0-21swapper/207:48:032
3128199130,12cyclictest0-21swapper/210:51:032
3128099138,3cyclictest0-21swapper/112:20:181
3128099132,6cyclictest0-21swapper/108:10:011
31280991310,2cyclictest3436-21kworker/u8:008:58:031
31280991310,2cyclictest3218-21kworker/u8:207:34:031
31280991310,2cyclictest31532-21kworker/u8:107:21:041
31280991310,2cyclictest31532-21kworker/u8:107:21:031
31280991310,2cyclictest29463-21kworker/u8:007:11:051
31280991310,2cyclictest27747-21kworker/u8:008:32:041
31280991310,2cyclictest27462-21kworker/u8:209:31:041
31280991310,2cyclictest0-21swapper/112:04:531
31280991310,2cyclictest0-21swapper/111:07:101
31280991310,2cyclictest0-21swapper/108:40:211
31280991310,2cyclictest0-21swapper/107:40:501
3128099130,2cyclictest15387-21diskmemload09:15:001
3128099130,2cyclictest0-21swapper/110:05:051
3128099130,12cyclictest0-21swapper/112:36:171
3128099130,12cyclictest0-21swapper/112:08:271
3128099130,12cyclictest0-21swapper/111:19:101
3128099130,12cyclictest0-21swapper/110:43:531
3128099130,11cyclictest0-21swapper/112:11:501
3128099130,11cyclictest0-21swapper/108:20:211
3128099130,11cyclictest0-21swapper/108:15:221
3128099130,11cyclictest0-21swapper/107:55:201
3128099130,11cyclictest0-21swapper/107:45:211
3127999138,3cyclictest0-21swapper/010:01:040
3127999138,3cyclictest0-21swapper/009:55:090
31279991310,2cyclictest0-21swapper/011:49:320
31279991310,2cyclictest0-21swapper/011:08:020
31279991310,2cyclictest0-21swapper/009:47:120
3127999130,2cyclictest15387-21diskmemload11:40:110
3127999130,2cyclictest0-21swapper/012:10:120
3127999130,11cyclictest0-21swapper/012:30:090
3127999130,11cyclictest0-21swapper/012:30:080
3127999130,11cyclictest0-21swapper/011:50:280
3128299129,2cyclictest0-21swapper/312:12:003
3128299129,2cyclictest0-21swapper/308:49:093
3128299129,2cyclictest0-21swapper/308:10:193
3128299123,6cyclictest0-21swapper/307:15:233
3128299122,7cyclictest0-21swapper/308:19:593
3128299120,2cyclictest0-21swapper/307:50:013
3128299120,11cyclictest0-21swapper/310:35:353
3128299120,11cyclictest0-21swapper/308:55:163
3128299120,11cyclictest0-21swapper/308:30:213
3128299120,11cyclictest0-21swapper/307:10:153
3128199129,2cyclictest0-21swapper/209:49:152
3128199127,3cyclictest3116-21munin-node2
3128199127,3cyclictest3116-21munin-node2
3128199120,11cyclictest0-21swapper/209:40:172
3128199120,11cyclictest0-21swapper/208:45:142
3128099129,2cyclictest25143-21kworker/u8:212:30:031
3128099129,2cyclictest25143-21kworker/u8:212:30:031
3128099129,2cyclictest11623-21kworker/u8:209:01:031
3128099129,2cyclictest0-21swapper/109:20:071
3128099121,9cyclictest29719-21apt-get08:25:101
3128099121,9cyclictest0-21swapper/108:45:121
3128099120,3cyclictest0-21swapper/108:10:171
3127999129,2cyclictest0-21swapper/010:33:050
3127999129,2cyclictest0-21swapper/009:15:010
3127999128,2cyclictest1013-21ssh11:15:230
3127999123,7cyclictest19266-21chrt07:58:070
3127999122,7cyclictest0-21swapper/008:34:590
3127999122,7cyclictest0-21swapper/008:18:010
3127999121,9cyclictest21452-21munin-run08:05:000
3127999120,2cyclictest0-21swapper/011:32:490
3127999120,2cyclictest0-21swapper/009:30:030
3127999120,11cyclictest0-21swapper/011:55:410
3128199118,2cyclictest15387-21diskmemload10:15:332
3128199110,2cyclictest0-21swapper/208:56:022
3128099111,8cyclictest16891-21timerwakeupswit07:50:301
3128099111,8cyclictest13987-21df_inode09:05:141
3128099111,8cyclictest0-21swapper/108:00:141
3128099110,3cyclictest0-21swapper/107:25:141
3127999118,2cyclictest0-21swapper/009:50:090
3127999118,2cyclictest0-21swapper/009:13:050
3127999112,7cyclictest0-21swapper/008:56:590
3127999110,9cyclictest0-21swapper/009:00:150
3127999110,2cyclictest0-21swapper/007:10:180
3128299107,2cyclictest0-21swapper/307:30:193
3128299107,2cyclictest0-21swapper/307:20:263
3128299107,2cyclictest0-21swapper/307:20:263
3128299102,7cyclictest0-21swapper/308:43:023
3128299102,5cyclictest0-21swapper/308:35:583
3128299100,8cyclictest21166-21kworker/u8:208:21:033
3128099107,2cyclictest1019-21kworker/u8:208:35:031
3127999107,2cyclictest0-21swapper/007:30:310
3127999105,3cyclictest5133-21latency_hist07:25:010
3127999105,3cyclictest5133-21latency_hist07:25:000
312829994,3cyclictest13625-21aten2.4-expect09:05:123
312829990,8cyclictest21166-21kworker/u8:208:26:043
312799995,2cyclictest0-21swapper/008:50:060
312799994,3cyclictest9668-21df_abs07:35:130
312799994,3cyclictest1076-21tail07:15:120
312799990,2cyclictest0-21swapper/007:40:120
312819983,3cyclictest23768-21head08:10:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional