You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-01-23 - 20:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Thu Jan 23, 2025 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6464211996,18sleep00-21swapper/007:05:380
6692211798,14sleep10-21swapper/107:08:351
6631211597,12sleep20-21swapper/207:07:482
6462210897,6sleep30-21swapper/307:05:373
200182720,1sleep30-21swapper/309:00:153
683099210,19cyclictest0-21swapper/312:15:133
682899213,16cyclictest0-21swapper/109:35:111
682899210,19cyclictest0-21swapper/110:10:071
683099200,2cyclictest0-21swapper/309:50:093
6829992017,2cyclictest5315-21kworker/u8:012:06:052
155612200,1sleep3381ktimersoftd/311:59:593
72462190,0sleep30-21swapper/310:02:033
6829991916,2cyclictest24423-21kworker/u8:010:23:052
682799190,2cyclictest0-21swapper/009:15:100
6829991815,2cyclictest31018-21kworker/u8:109:20:042
682999180,2cyclictest0-21swapper/211:49:052
6829991714,2cyclictest3334-21kworker/u8:210:41:052
6829991714,2cyclictest31773-21kworker/u8:111:11:042
6829991714,2cyclictest31773-21kworker/u8:111:11:042
6829991714,2cyclictest23718-21kworker/u8:210:18:052
6829991714,2cyclictest23718-21kworker/u8:210:13:052
682899170,2cyclictest0-21swapper/107:10:121
683099161,13cyclictest27397-21ssh10:25:053
682999161,3cyclictest9740-21iostat_ios07:15:162
6829991613,2cyclictest7206-21kworker/u8:007:28:042
6829991613,2cyclictest23718-21kworker/u8:209:11:052
6829991613,2cyclictest20016-21kworker/u8:010:57:062
6829991613,2cyclictest15051-21kworker/u8:110:48:042
682999160,2cyclictest0-21swapper/212:18:052
682899161,13cyclictest18926-21apt-get09:40:121
682899161,13cyclictest0-21swapper/108:00:141
6828991611,3cyclictest0-21swapper/107:55:251
6827991610,2cyclictest18128-21rm12:38:040
683099159,3cyclictest23287-21diskmemload09:15:083
6830991512,2cyclictest0-21swapper/309:22:333
6830991511,2cyclictest0-21swapper/307:45:133
683099150,13cyclictest0-21swapper/309:37:023
682999151,3cyclictest8440-21ssh09:29:122
682999151,3cyclictest0-21swapper/209:45:262
682999151,3cyclictest0-21swapper/209:34:022
6829991512,2cyclictest19405-21kworker/u8:208:05:042
6829991512,2cyclictest13505-21kworker/u8:108:54:052
682999151,12cyclictest29885-21ssh09:52:102
682999151,12cyclictest11481-21grep12:30:212
682999150,2cyclictest0-21swapper/211:43:042
682999150,2cyclictest0-21swapper/211:25:062
682999150,13cyclictest9516-21ssh11:16:172
682999150,13cyclictest31709-21cpu08:10:162
682999150,13cyclictest21459-21latency_hist09:05:002
6828991510,3cyclictest17758-21tr08:55:131
6828991510,3cyclictest0-21swapper/111:18:561
6828991510,3cyclictest0-21swapper/108:35:161
682899150,13cyclictest0-21swapper/109:47:261
682899150,13cyclictest0-21swapper/109:20:151
6827991512,2cyclictest7530-21kworker/u8:211:49:050
96482140,2sleep10-21swapper/107:15:161
6830991411,2cyclictest23287-21diskmemload10:20:223
6830991411,2cyclictest0-21swapper/312:35:293
6830991411,2cyclictest0-21swapper/312:06:023
6830991411,2cyclictest0-21swapper/311:03:323
683099140,2cyclictest19096-21aten2.4-expect09:40:123
683099140,2cyclictest10411-21diskstats12:30:093
683099140,2cyclictest0-21swapper/311:50:223
683099140,2cyclictest0-21swapper/311:15:223
683099140,13cyclictest23287-21diskmemload12:29:223
683099140,13cyclictest23287-21diskmemload10:43:333
683099140,13cyclictest0-21swapper/312:20:323
683099140,13cyclictest0-21swapper/310:33:323
683099140,12cyclictest0-21swapper/312:00:183
683099140,12cyclictest0-21swapper/310:35:363
683099140,12cyclictest0-21swapper/309:45:493
683099140,12cyclictest0-21swapper/309:26:173
683099140,12cyclictest0-21swapper/308:40:173
683099140,12cyclictest0-21swapper/307:20:243
6829991411,2cyclictest9536-21kworker/u8:009:16:042
6829991411,2cyclictest7700-21kworker/u8:110:07:032
6829991411,2cyclictest7206-21kworker/u8:007:51:042
6829991411,2cyclictest31773-21kworker/u8:111:08:052
6829991411,2cyclictest23287-21diskmemload12:39:072
6829991411,2cyclictest19405-21kworker/u8:208:01:042
6829991411,2cyclictest0-21swapper/212:21:472
6829991411,2cyclictest0-21swapper/211:23:072
6829991411,2cyclictest0-21swapper/210:35:022
682999140,2cyclictest0-21swapper/211:56:072
682999140,2cyclictest0-21swapper/209:36:572
682999140,13cyclictest0-21swapper/210:01:372
682999140,12cyclictest0-21swapper/209:41:042
682899149,3cyclictest0-21swapper/110:50:301
6828991411,2cyclictest0-21swapper/111:44:201
6828991410,2cyclictest22571-21apt-get10:20:091
682899140,12cyclictest23287-21diskmemload12:07:061
682899140,12cyclictest23287-21diskmemload11:00:101
682899140,12cyclictest23287-21diskmemload10:42:461
682899140,12cyclictest0-21swapper/111:32:251
682899140,12cyclictest0-21swapper/109:33:361
682899140,12cyclictest0-21swapper/109:10:151
682899140,12cyclictest0-21swapper/108:50:251
682799140,12cyclictest0-21swapper/009:55:200
282962140,2sleep10-21swapper/112:14:171
264372140,2sleep20-21swapper/211:00:072
683099131,2cyclictest14491-21ssh10:10:313
6830991310,2cyclictest23287-21diskmemload11:40:223
6830991310,2cyclictest18696-21ssh10:51:023
6830991310,2cyclictest0-21swapper/312:12:033
6830991310,2cyclictest0-21swapper/311:30:503
6830991310,2cyclictest0-21swapper/311:25:103
6830991310,2cyclictest0-21swapper/310:06:103
6830991310,2cyclictest0-21swapper/309:58:013
683099130,2cyclictest0-21swapper/311:20:223
683099130,2cyclictest0-21swapper/311:06:023
683099130,2cyclictest0-21swapper/309:33:093
683099130,2cyclictest0-21swapper/308:50:233
683099130,12cyclictest0-21swapper/311:35:233
683099130,12cyclictest0-21swapper/311:10:123
683099130,12cyclictest0-21swapper/311:10:123
683099130,12cyclictest0-21swapper/310:19:393
683099130,12cyclictest0-21swapper/309:11:253
683099130,12cyclictest0-21swapper/308:04:373
683099130,11cyclictest23287-21diskmemload10:45:123
6829991310,2cyclictest9536-21kworker/u8:009:07:032
6829991310,2cyclictest9536-21kworker/u8:008:38:042
6829991310,2cyclictest6816-21kworker/u8:208:31:032
6829991310,2cyclictest2893-21kworker/u8:107:11:042
6829991310,2cyclictest24423-21kworker/u8:010:30:042
6829991310,2cyclictest0-21swapper/212:27:542
6829991310,2cyclictest0-21swapper/212:02:452
6829991310,2cyclictest0-21swapper/211:30:582
6829991310,2cyclictest0-21swapper/210:52:172
6829991310,2cyclictest0-21swapper/209:56:092
682999130,2cyclictest13240-21copy08:45:022
682999130,2cyclictest0-21swapper/212:10:042
682999130,12cyclictest23287-21diskmemload11:35:482
682999130,12cyclictest0-21swapper/211:51:172
682999130,12cyclictest0-21swapper/210:28:102
682899138,3cyclictest0-21swapper/108:10:291
682899131,3cyclictest0-21swapper/107:50:291
6828991310,2cyclictest0-21swapper/112:36:351
6828991310,2cyclictest0-21swapper/111:59:441
6828991310,2cyclictest0-21swapper/111:50:161
6828991310,2cyclictest0-21swapper/111:36:041
6828991310,2cyclictest0-21swapper/110:35:121
6828991310,2cyclictest0-21swapper/110:09:251
682899130,2cyclictest0-21swapper/112:27:041
682899130,2cyclictest0-21swapper/111:49:131
682899130,2cyclictest0-21swapper/111:20:191
682899130,2cyclictest0-21swapper/110:57:141
682899130,2cyclictest0-21swapper/110:33:561
682899130,2cyclictest0-21swapper/109:57:131
682899130,2cyclictest0-21swapper/107:35:191
682899130,12cyclictest23287-21diskmemload11:06:041
682899130,12cyclictest0-21swapper/110:28:161
682899130,12cyclictest0-21swapper/110:01:341
682899130,12cyclictest0-21swapper/109:26:231
682899130,11cyclictest0-21swapper/112:15:541
682899130,11cyclictest0-21swapper/112:00:551
6827991310,2cyclictest5315-21kworker/u8:012:18:060
6827991310,2cyclictest15121-21kworker/u8:011:25:050
260372130,2sleep00-21swapper/010:23:210
155452130,2sleep00-21swapper/010:12:110
683099129,2cyclictest15173-21apt-get07:30:143
683099129,2cyclictest0-21swapper/310:55:173
683099129,2cyclictest0-21swapper/307:50:243
683099120,11cyclictest0-21swapper/311:47:473
683099120,11cyclictest0-21swapper/308:55:233
683099120,10cyclictest0-21swapper/307:38:233
682999129,2cyclictest9536-21kworker/u8:008:40:042
682999129,2cyclictest7206-21kworker/u8:007:20:042
682999129,2cyclictest15161-21kworker/u8:107:31:042
682999127,3cyclictest0-21swapper/208:20:142
682999120,1cyclictest0-21swapper/207:55:072
682899129,2cyclictest0-21swapper/112:21:141
682899129,2cyclictest0-21swapper/108:45:241
682899129,2cyclictest0-21swapper/108:25:161
682899127,3cyclictest7359-21munin-node1
682899122,7cyclictest0-21swapper/107:20:001
682899121,9cyclictest5127-21munin-run08:25:001
682899121,9cyclictest2319-21munin-node1
682899121,9cyclictest2319-21munin-node1
682899121,9cyclictest15170-21munin-node1
682899121,9cyclictest0-21swapper/109:50:091
682899121,9cyclictest0-21swapper/107:45:141
682899121,3cyclictest23287-21diskmemload10:15:111
682899120,3cyclictest0-21swapper/108:40:241
682899120,11cyclictest0-21swapper/111:25:061
682899120,11cyclictest0-21swapper/110:47:431
682899120,11cyclictest0-21swapper/109:15:541
682899120,11cyclictest0-21swapper/109:00:131
682899120,10cyclictest0-21swapper/107:25:141
682799129,2cyclictest0-21swapper/012:30:070
682799120,2cyclictest0-21swapper/009:10:290
682799120,11cyclictest0-21swapper/012:10:080
682799120,11cyclictest0-21swapper/011:05:320
682799120,11cyclictest0-21swapper/010:51:000
682799120,11cyclictest0-21swapper/010:04:120
682799120,11cyclictest0-21swapper/009:30:150
682799120,10cyclictest0-21swapper/011:41:400
65102120,1sleep00-21swapper/011:14:120
65102120,1sleep00-21swapper/011:14:120
203382120,1sleep00-21swapper/012:04:460
683099118,2cyclictest0-21swapper/307:55:023
683099117,3cyclictest1621-21fschecks_time08:15:153
683099117,3cyclictest0-21swapper/308:10:153
683099116,3cyclictest8434-21head07:10:263
683099110,10cyclictest0-21swapper/308:37:233
682999118,2cyclictest15161-21kworker/u8:107:39:052
682999118,2cyclictest13505-21kworker/u8:108:57:042
682999118,2cyclictest0-21swapper/208:15:132
682999110,1cyclictest0-21swapper/207:45:132
682899119,1cyclictest0-21swapper/107:40:151
682899118,2cyclictest0-21swapper/108:15:171
682899118,2cyclictest0-21swapper/108:05:161
682899116,3cyclictest0-21swapper/112:30:201
682799118,2cyclictest3202-21apt-get08:20:130
682799118,2cyclictest0-21swapper/010:32:110
682799118,2cyclictest0-21swapper/010:05:080
682799118,2cyclictest0-21swapper/007:35:120
682799114,5cyclictest28031-21sh10:26:040
682799110,2cyclictest23287-21diskmemload10:48:000
682799110,2cyclictest23287-21diskmemload10:40:000
682799110,10cyclictest0-21swapper/012:28:000
682799110,10cyclictest0-21swapper/011:01:100
682799110,10cyclictest0-21swapper/009:39:010
682799110,10cyclictest0-21swapper/009:05:180
34712110,8sleep00-21swapper/009:22:040
79322100,7sleep00-21swapper/009:28:260
683099107,2cyclictest0-21swapper/307:15:183
683099102,6cyclictest4572-21gdm-simple-gree07:41:583
683099101,6cyclictest0-21swapper/308:45:223
683099100,7cyclictest0-21swapper/308:05:013
682999100,2cyclictest0-21swapper/208:27:042
682899101,7cyclictest22606-21python09:05:231
682799107,2cyclictest27318-21ssh11:36:000
682799107,2cyclictest23287-21diskmemload10:37:490
682799107,2cyclictest0-21swapper/011:32:340
682799107,2cyclictest0-21swapper/010:18:390
682799100,9cyclictest0-21swapper/011:54:000
682799100,9cyclictest0-21swapper/011:16:460
682799100,9cyclictest0-21swapper/010:57:220
682799100,9cyclictest0-21swapper/009:46:510
682799100,2cyclictest23287-21diskmemload09:40:340
682799100,2cyclictest0-21swapper/012:20:400
682799100,2cyclictest0-21swapper/009:50:410
7002290,1sleep30-21swapper/308:28:223
68309996,2cyclictest0-21swapper/309:05:133
68309994,3cyclictest3587-21df_abs08:20:153
68299994,3cyclictest19346-21basename07:40:122
68279996,2cyclictest0-21swapper/012:07:180
68279996,2cyclictest0-21swapper/011:55:540
68279995,2cyclictest25750-21cut07:55:130
68279990,8cyclictest0-21swapper/007:15:200
68279990,2cyclictest0-21swapper/011:21:480
13120290,1sleep30-21swapper/307:25:083
68279985,2cyclictest19405-21kworker/u8:208:15:050
68279985,2cyclictest0-21swapper/008:50:160
68279985,2cyclictest0-21swapper/008:26:220
68279985,2cyclictest0-21swapper/007:40:160
68279984,3cyclictest2569-21munin-node07:50:000
68279983,4cyclictest0-21swapper/007:33:030
68279983,3cyclictest3594-21Xorg09:01:580
68279983,3cyclictest32013-21fschecks_count08:10:170
68279981,6cyclictest19096-21kworker/0:207:20:160
68279980,7cyclictest7206-21kworker/u8:008:07:030
68279980,7cyclictest0-21swapper/008:04:520
68279980,2cyclictest0-21swapper/008:56:510
68309974,2cyclictest0-21swapper/308:30:163
68279973,3cyclictest9365-21taskset08:35:050
68279973,3cyclictest8073-21cut07:10:230
68279973,3cyclictest7391-21tail08:30:150
68279973,3cyclictest23394-21aten2.4-expect07:50:170
68279972,3cyclictest13907-21fschecks_count08:45:130
68279970,6cyclictest13422-21tr07:25:130
11470270,3sleep00-21swapper/008:40:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional