You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-16 - 13:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Tue Jul 16, 2024 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28480211795,16sleep10-21swapper/119:06:411
55421090,4sleep32876999cyclictest23:15:363
27562210979,6sleep00-21swapper/019:05:200
28627210796,6sleep20-21swapper/219:08:352
28699210189,6sleep30-21swapper/319:09:323
40482790,0sleep00-21swapper/021:35:160
40482790,0sleep00-21swapper/021:35:150
66732720,0sleep20-21swapper/222:47:412
209132710,0sleep20-21swapper/223:03:162
177912680,0sleep20-21swapper/220:00:332
2876799341,18cyclictest0-21swapper/100:05:131
153012270,0sleep20-21swapper/200:06:222
108812260,0sleep00-21swapper/022:17:090
2876799221,19cyclictest9713-21cat22:15:351
325312210,1sleep10-21swapper/119:17:101
2876799211,2cyclictest0-21swapper/123:40:101
2876799210,3cyclictest21259-21kworker/u8:223:06:491
2876799210,3cyclictest15066-21ssh22:56:171
2876799210,3cyclictest0-21swapper/122:30:001
2876799210,3cyclictest0-21swapper/100:15:131
2876799210,3cyclictest0-21swapper/100:15:121
2876799210,2cyclictest0-21swapper/123:24:311
2876799210,2cyclictest0-21swapper/100:10:271
104672210,0sleep10-21swapper/100:00:591
2876999200,2cyclictest0-21swapper/323:40:103
2876899200,2cyclictest0-21swapper/220:35:112
2876899200,19cyclictest0-21swapper/221:45:102
28767992011,7cyclictest0-21swapper/122:00:241
2876799200,3cyclictest2828-21ssh22:44:171
2876799200,3cyclictest26676-21ssh22:35:001
2876799200,3cyclictest2417-21taskset21:34:011
2876799200,3cyclictest15130-21ssh21:46:401
2876799200,3cyclictest0-21swapper/122:22:201
2876799200,3cyclictest0-21swapper/121:35:291
2876799200,3cyclictest0-21swapper/121:35:281
2876799200,2cyclictest4312-21nscd21:15:241
2876799200,2cyclictest20458-21ssh23:37:201
2876799200,2cyclictest12326-21diskmemload23:04:481
2876799200,2cyclictest0-21swapper/123:52:081
2876799200,2cyclictest0-21swapper/123:45:411
2876799200,2cyclictest0-21swapper/123:25:121
2876799200,2cyclictest0-21swapper/122:14:401
2876799200,2cyclictest0-21swapper/121:55:011
2876799200,2cyclictest0-21swapper/121:20:191
2876799200,2cyclictest0-21swapper/100:30:171
128452200,2sleep012851-21latency_hist23:30:000
43332190,1sleep04336-21fschecks_time23:20:180
2876999190,18cyclictest0-21swapper/319:30:123
2876899190,4cyclictest0-21swapper/223:47:042
2876899190,17cyclictest0-21swapper/222:44:052
2876799190,3cyclictest7562-21rm23:58:521
2876799190,3cyclictest0-21swapper/123:16:411
2876799190,2cyclictest32374-21ssh00:25:171
2876799190,2cyclictest17610-21aten2.4-expect21:50:131
2876799190,2cyclictest10397-21ssh00:35:521
2876799190,2cyclictest0-21swapper/123:31:391
2876799190,2cyclictest0-21swapper/123:10:321
2876799190,2cyclictest0-21swapper/122:50:161
2876799190,2cyclictest0-21swapper/122:45:161
2876799190,2cyclictest0-21swapper/122:30:171
2876799190,2cyclictest0-21swapper/121:42:311
2876799190,2cyclictest0-21swapper/119:35:241
2876799190,17cyclictest0-21swapper/120:05:131
306192180,0sleep30-21swapper/320:35:003
2876799180,2cyclictest5095-21runrttasks20:26:201
2876799180,2cyclictest2538-21apt-get19:25:121
2876799180,2cyclictest0-21swapper/122:05:131
2876799180,2cyclictest0-21swapper/121:25:561
2876799180,2cyclictest0-21swapper/121:10:371
2876799180,2cyclictest0-21swapper/121:05:211
2876799180,2cyclictest0-21swapper/121:00:361
2876799180,2cyclictest0-21swapper/120:50:161
2876799180,2cyclictest0-21swapper/120:45:251
2876799180,2cyclictest0-21swapper/120:35:211
2876799180,2cyclictest0-21swapper/120:30:331
2876799180,2cyclictest0-21swapper/120:15:281
2876799180,2cyclictest0-21swapper/120:00:121
2876799180,2cyclictest0-21swapper/119:45:251
2876799180,2cyclictest0-21swapper/119:30:131
2876799180,2cyclictest0-21swapper/119:10:321
2876799180,2cyclictest0-21swapper/100:20:041
28769991714,2cyclictest12808-21kworker/u8:121:20:053
2876899170,15cyclictest0-21swapper/200:24:042
2876799170,2cyclictest0-21swapper/120:40:241
2876799170,2cyclictest0-21swapper/120:20:091
2876799170,2cyclictest0-21swapper/120:10:251
2876799170,2cyclictest0-21swapper/119:55:211
2876799170,2cyclictest0-21swapper/119:52:321
2876799170,2cyclictest0-21swapper/119:42:171
2876799170,2cyclictest0-21swapper/119:20:171
2876799170,1cyclictest0-21swapper/120:55:131
28766991714,2cyclictest31668-21kworker/u8:023:51:040
28766991714,2cyclictest31668-21kworker/u8:000:01:040
28769991613,2cyclictest24283-21kworker/u8:222:35:043
2876999160,13cyclictest0-21swapper/300:31:453
2876899160,14cyclictest0-21swapper/223:05:142
28766991613,2cyclictest24283-21kworker/u8:222:34:050
2876699161,13cyclictest12539-21copy21:45:010
2876699160,13cyclictest18846-21timerandwakeup21:50:330
2876999158,6cyclictest9851-21ssh00:00:333
2876999151,2cyclictest12326-21diskmemload23:46:043
28769991512,2cyclictest30474-21kworker/u8:121:35:043
28769991512,2cyclictest30474-21kworker/u8:121:35:033
28769991512,2cyclictest25586-21kworker/u8:221:26:043
2876999150,7cyclictest0-21swapper/321:52:053
2876999150,13cyclictest0-21swapper/323:35:163
2876899151,12cyclictest17756-21apt-get00:10:082
2876699151,3cyclictest31816-21tr21:30:180
28766991512,2cyclictest20449-21kworker/u8:219:34:050
2876699151,12cyclictest14990-21ssh00:05:500
2876699150,2cyclictest0-21swapper/023:46:050
2876699150,13cyclictest0-21swapper/023:05:470
2876699150,13cyclictest0-21swapper/021:10:290
28769991411,2cyclictest6486-21kworker/u8:121:02:043
28769991411,2cyclictest21259-21kworker/u8:223:04:043
28769991411,2cyclictest12842-21kworker/u8:120:15:053
28769991411,2cyclictest12808-21kworker/u8:121:15:053
28769991410,2cyclictest13392-21munin-node3
2876999140,12cyclictest0-21swapper/321:34:133
2876999140,12cyclictest0-21swapper/320:00:133
2876999140,12cyclictest0-21swapper/300:16:323
2876999140,12cyclictest0-21swapper/300:16:313
2876899140,2cyclictest0-21swapper/223:41:312
2876899140,12cyclictest32417-21cat23:50:192
2876899140,12cyclictest27081-21df20:25:122
2876899140,12cyclictest0-21swapper/223:55:092
2876899140,12cyclictest0-21swapper/222:37:192
2876899140,12cyclictest0-21swapper/222:05:312
2876899140,12cyclictest0-21swapper/221:16:572
2876899140,12cyclictest0-21swapper/200:31:272
2876699149,3cyclictest1623-21rm22:07:250
28766991411,2cyclictest0-21swapper/022:02:000
28766991410,2cyclictest16495-21latency_hist20:00:000
28766991410,2cyclictest12961-21ssh22:20:130
2876699140,2cyclictest0-21swapper/019:35:210
2876699140,13cyclictest0-21swapper/021:25:110
2876699140,12cyclictest0-21swapper/023:40:490
2876699140,12cyclictest0-21swapper/022:50:110
2876699140,12cyclictest0-21swapper/021:59:040
198652140,2sleep00-21swapper/023:36:220
29292130,2sleep00-21swapper/022:44:280
28769991310,2cyclictest29548-21ssh23:12:163
28769991310,2cyclictest24506-21ssh22:31:443
28769991310,2cyclictest24283-21kworker/u8:222:07:043
28769991310,2cyclictest18751-21kworker/u8:220:55:053
28769991310,2cyclictest12326-21diskmemload21:42:343
28769991310,2cyclictest0-21swapper/323:08:273
28769991310,2cyclictest0-21swapper/322:51:553
28769991310,2cyclictest0-21swapper/322:42:133
28769991310,2cyclictest0-21swapper/322:24:423
28769991310,2cyclictest0-21swapper/322:01:073
28769991310,2cyclictest0-21swapper/321:46:063
2876999130,2cyclictest12326-21diskmemload00:22:433
2876999130,2cyclictest12326-21diskmemload00:12:333
2876999130,2cyclictest12325-21apt-get21:10:043
2876999130,2cyclictest0-21swapper/319:50:243
2876999130,12cyclictest0-21swapper/300:28:463
2876999130,11cyclictest5816-21ssh23:21:053
2876999130,11cyclictest0-21swapper/323:31:263
2876899139,3cyclictest0-21swapper/222:53:192
28768991310,2cyclictest12326-21diskmemload23:20:282
28768991310,2cyclictest0-21swapper/223:32:172
28768991310,2cyclictest0-21swapper/221:57:392
28768991310,2cyclictest0-21swapper/221:50:342
28768991310,2cyclictest0-21swapper/221:35:292
28768991310,2cyclictest0-21swapper/221:35:292
28768991310,2cyclictest0-21swapper/221:30:372
28768991310,2cyclictest0-21swapper/221:28:172
28768991310,2cyclictest0-21swapper/221:20:322
28768991310,2cyclictest0-21swapper/220:55:152
28768991310,2cyclictest0-21swapper/220:15:282
28768991310,2cyclictest0-21swapper/200:00:162
2876899130,2cyclictest8413-21wc21:40:132
2876899130,2cyclictest14120-21timerandwakeup21:10:402
2876899130,2cyclictest0-21swapper/223:19:132
2876899130,2cyclictest0-21swapper/221:00:112
2876899130,2cyclictest0-21swapper/219:45:002
2876899130,2cyclictest0-21swapper/219:35:242
2876899130,2cyclictest0-21swapper/200:37:502
2876899130,12cyclictest0-21swapper/219:25:282
2876899130,11cyclictest14300-21ssh22:55:322
2876899130,11cyclictest0-21swapper/223:27:192
2876699138,3cyclictest0-21swapper/022:35:170
2876699131,10cyclictest0-21swapper/020:19:590
28766991310,2cyclictest12326-21diskmemload23:10:220
28766991310,2cyclictest0-21swapper/023:00:350
28766991310,2cyclictest0-21swapper/022:56:010
28766991310,2cyclictest0-21swapper/020:09:310
28766991310,2cyclictest0-21swapper/000:39:400
28766991310,2cyclictest0-21swapper/000:18:060
28766991310,2cyclictest0-21swapper/000:18:050
2876699130,8cyclictest0-21swapper/000:25:040
2876699130,2cyclictest0-21swapper/022:11:200
2876699130,2cyclictest0-21swapper/021:45:200
2876699130,2cyclictest0-21swapper/021:20:110
2876699130,2cyclictest0-21swapper/000:13:410
2876699130,12cyclictest0-21swapper/019:20:000
2876699130,11cyclictest20062-21ssh22:27:000
126152130,2sleep312326-21diskmemload23:29:403
290292120,2sleep00-21swapper/000:21:110
2876999129,2cyclictest3849-21kworker/u8:000:35:053
2876999129,2cyclictest18751-21kworker/u8:220:28:043
2876999129,2cyclictest10954-21kworker/u8:222:57:033
2876999129,2cyclictest0-21swapper/321:55:063
2876999129,2cyclictest0-21swapper/321:05:153
2876999129,2cyclictest0-21swapper/320:05:323
2876999122,7cyclictest0-21swapper/320:11:013
2876999120,2cyclictest0-21swapper/322:47:443
2876999120,2cyclictest0-21swapper/322:12:133
2876999120,2cyclictest0-21swapper/320:45:133
2876999120,2cyclictest0-21swapper/320:20:153
2876999120,11cyclictest0-21swapper/323:51:153
2876999120,11cyclictest0-21swapper/322:25:263
2876999120,11cyclictest0-21swapper/322:19:333
2876999120,11cyclictest0-21swapper/319:45:133
2876899129,2cyclictest9006-21if_err_eth022:15:212
2876899129,2cyclictest0-21swapper/222:10:022
2876899129,2cyclictest0-21swapper/219:50:172
2876899129,2cyclictest0-21swapper/200:15:242
2876899129,2cyclictest0-21swapper/200:15:242
2876899121,9cyclictest14715-21munin-node2
2876899120,2cyclictest0-21swapper/222:26:582
2876899120,2cyclictest0-21swapper/220:40:392
2876899120,2cyclictest0-21swapper/220:20:292
2876899120,11cyclictest12326-21diskmemload00:25:042
2876899120,11cyclictest0-21swapper/223:37:142
2876899120,11cyclictest0-21swapper/223:11:222
2876899120,11cyclictest0-21swapper/222:32:212
2876899120,11cyclictest0-21swapper/222:23:262
2876899120,11cyclictest0-21swapper/221:05:222
2876899120,11cyclictest0-21swapper/219:30:242
2876899120,11cyclictest0-21swapper/219:15:132
2876699129,2cyclictest0-21swapper/022:46:130
2876699129,2cyclictest0-21swapper/021:05:110
2876699129,2cyclictest0-21swapper/020:25:190
2876699127,2cyclictest396-21kworker/u8:020:44:040
2876699120,2cyclictest0-21swapper/023:55:190
2876699120,2cyclictest0-21swapper/020:55:270
2876699120,2cyclictest0-21swapper/020:45:200
2876699120,2cyclictest0-21swapper/019:25:150
2876699120,2cyclictest0-21swapper/000:31:330
2876699120,11cyclictest0-21swapper/023:30:110
173742120,2sleep00-21swapper/021:15:160
2876999118,2cyclictest2699-21kworker/u8:019:41:053
2876999118,2cyclictest2699-21kworker/u8:019:37:033
2876999118,2cyclictest20449-21kworker/u8:219:55:043
2876999118,2cyclictest20449-21kworker/u8:219:21:043
2876999112,6cyclictest0-21swapper/320:44:593
2876999110,2cyclictest0-21swapper/323:57:523
2876899118,2cyclictest0-21swapper/222:00:242
2876899118,2cyclictest0-21swapper/220:45:282
2876899118,2cyclictest0-21swapper/219:45:382
2876899118,2cyclictest0-21swapper/219:20:152
2876899110,9cyclictest0-21swapper/220:05:252
2876899110,10cyclictest0-21swapper/220:10:262
2876899110,10cyclictest0-21swapper/219:10:222
2876699118,2cyclictest0-21swapper/020:00:320
2876699118,2cyclictest0-21swapper/019:16:300
2876699112,7cyclictest5883-21gdm-simple-gree19:13:590
2876699112,7cyclictest4876-21Xorg20:22:590
2876699110,10cyclictest0-21swapper/023:15:480
54072100,2sleep00-21swapper/020:50:280
318612100,2sleep30-21swapper/319:15:253
2876999107,2cyclictest2699-21kworker/u8:019:26:053
2876999107,2cyclictest18751-21kworker/u8:220:35:043
2876899100,8cyclictest28778-21apt-get20:30:112
2876699107,2cyclictest12842-21kworker/u8:120:10:050
2876699107,2cyclictest0-21swapper/020:30:140
2876699105,3cyclictest8481-21cron19:39:590
2876699105,3cyclictest13034-21df_abs19:50:130
2876699102,6cyclictest0-21swapper/020:40:000
2876699101,6cyclictest11279-21perl19:45:180
287699996,2cyclictest0-21swapper/320:50:163
287689996,2cyclictest301ktimersoftd/220:50:132
287669994,3cyclictest8830-21cut21:00:150
287699983,3cyclictest29045-21tail19:10:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional