You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-29 - 12:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack3slot6s.osadl.org (updated Mon Dec 29, 2025 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1935211795,16sleep10-21swapper/119:07:131
1825211794,18sleep00-21swapper/019:05:470
353211496,12sleep30-21swapper/319:05:053
2051211494,15sleep20-21swapper/219:08:412
67682800,0sleep10-21swapper/122:49:081
144772770,0sleep20-21swapper/221:41:432
247922760,0sleep10-21swapper/122:31:081
218299234,6cyclictest7497-21gdm-simple-gree23:53:580
68202220,1sleep06824-21cpuspeed_turbos19:20:120
218599220,20cyclictest0-21swapper/220:25:112
218399226,2cyclictest0-21swapper/123:15:111
218399221,3cyclictest18511-21diskmemload22:15:121
218899211,18cyclictest18099-21ssh23:40:133
218599210,2cyclictest0-21swapper/200:15:122
218399210,19cyclictest0-21swapper/120:20:151
218399210,19cyclictest0-21swapper/120:20:141
218299210,2cyclictest0-21swapper/022:25:130
218299210,2cyclictest0-21swapper/000:10:180
218299210,20cyclictest0-21swapper/021:44:510
218299210,19cyclictest0-21swapper/023:30:160
218299210,19cyclictest0-21swapper/019:35:110
218299210,12cyclictest0-21swapper/019:10:030
218399200,2cyclictest0-21swapper/121:40:111
2182992017,2cyclictest0-21swapper/000:00:100
2182992010,2cyclictest18511-21diskmemload00:27:290
218299200,18cyclictest0-21swapper/023:57:220
218899192,7cyclictest0-21swapper/320:22:023
218899192,7cyclictest0-21swapper/320:22:023
218899192,7cyclictest0-21swapper/319:50:593
218299199,2cyclictest0-21swapper/022:21:250
218299198,2cyclictest0-21swapper/021:59:590
218299198,2cyclictest0-21swapper/021:00:160
2182991910,8cyclictest0-21swapper/022:39:010
2182991910,2cyclictest0-21swapper/023:11:460
218299190,2cyclictest18511-21diskmemload21:14:100
218299190,10cyclictest0-21swapper/000:19:090
218899182,5cyclictest0-21swapper/319:43:013
218299189,2cyclictest18511-21diskmemload00:22:260
218299188,2cyclictest0-21swapper/023:47:390
218299188,2cyclictest0-21swapper/022:55:350
218299188,2cyclictest0-21swapper/022:18:580
218299188,2cyclictest0-21swapper/022:14:380
218299188,2cyclictest0-21swapper/022:01:180
218299185,3cyclictest17579-21ps21:45:220
218299182,6cyclictest0-21swapper/000:35:260
218299180,8cyclictest25325-21cron21:16:590
218299180,2cyclictest0-21swapper/023:05:000
218299180,2cyclictest0-21swapper/023:01:470
218299180,2cyclictest0-21swapper/021:33:340
218299180,2cyclictest0-21swapper/000:07:490
218299180,16cyclictest0-21swapper/000:33:270
218299180,11cyclictest0-21swapper/023:36:350
218299180,11cyclictest0-21swapper/022:49:450
218299180,10cyclictest0-21swapper/022:53:420
218899172,6cyclictest0-21swapper/320:55:593
218399170,15cyclictest18511-21diskmemload21:50:121
218299179,2cyclictest0-21swapper/023:27:220
218299179,2cyclictest0-21swapper/023:27:210
218299179,2cyclictest0-21swapper/019:45:230
218299178,2cyclictest0-21swapper/021:29:010
218299170,6cyclictest0-21swapper/022:05:240
218899160,14cyclictest18511-21diskmemload22:30:133
218599161,13cyclictest10859-21ssh21:38:032
218599161,13cyclictest0-21swapper/220:35:182
218399162,8cyclictest0-21swapper/119:35:011
218299169,1cyclictest0-21swapper/021:37:550
218299162,6cyclictest0-21swapper/020:41:580
218299162,6cyclictest0-21swapper/019:57:590
218299161,6cyclictest0-21swapper/022:42:030
218299161,6cyclictest0-21swapper/020:46:410
218299160,6cyclictest0-21swapper/019:51:310
218299160,1cyclictest0-21swapper/021:51:270
218299160,10cyclictest0-21swapper/023:23:490
218899152,4cyclictest0-21swapper/320:06:013
218899151,3cyclictest28364-21ssh21:58:313
2188991512,2cyclictest18511-21diskmemload00:32:133
2188991512,2cyclictest0-21swapper/321:19:123
218899151,12cyclictest28929-21ssh21:20:373
218899151,12cyclictest2162-21apt-get19:10:053
218899151,12cyclictest18511-21diskmemload23:28:433
218899151,12cyclictest18511-21diskmemload23:28:423
218899151,12cyclictest17372-21ssh23:39:173
2188991510,3cyclictest0-21swapper/320:50:243
218899150,13cyclictest4211-21munin-run20:35:013
218899150,13cyclictest18511-21diskmemload23:21:033
218899150,13cyclictest18511-21diskmemload22:28:223
218899150,13cyclictest18511-21diskmemload00:25:533
218899150,13cyclictest0-21swapper/322:12:423
218899150,13cyclictest0-21swapper/319:55:193
218899150,13cyclictest0-21swapper/300:35:123
218599151,12cyclictest26807-21apt-get20:10:132
2185991510,3cyclictest11181-21ssh00:10:002
218599150,2cyclictest0-21swapper/222:25:132
218599150,13cyclictest29939-21grep22:00:142
218599150,13cyclictest18511-21diskmemload23:26:542
218599150,13cyclictest18511-21diskmemload23:26:532
218599150,13cyclictest0-21swapper/221:32:042
218599150,13cyclictest0-21swapper/220:25:012
218599150,13cyclictest0-21swapper/220:25:012
218599150,13cyclictest0-21swapper/200:00:492
218399151,12cyclictest0-21swapper/123:14:561
2183991511,2cyclictest0-21swapper/120:45:141
2183991510,3cyclictest0-21swapper/123:08:501
218299157,2cyclictest0-21swapper/023:40:090
218299150,9cyclictest0-21swapper/023:17:470
218299150,6cyclictest0-21swapper/019:41:290
37362140,2sleep10-21swapper/123:22:521
218899141,2cyclictest27628-21ntp_states23:50:213
2188991411,2cyclictest18511-21diskmemload23:11:133
2188991411,2cyclictest0-21swapper/321:43:473
2188991411,2cyclictest0-21swapper/321:34:403
218899140,2cyclictest0-21swapper/321:35:253
218899140,2cyclictest0-21swapper/320:40:183
218899140,12cyclictest0-21swapper/323:31:453
218899140,12cyclictest0-21swapper/321:25:593
218599149,3cyclictest0-21swapper/223:39:492
218599149,3cyclictest0-21swapper/221:26:212
218599141,2cyclictest27701-21diskstats21:20:142
2185991411,2cyclictest20042-21kworker/u8:222:16:042
2185991411,2cyclictest0-21swapper/223:20:342
2185991411,2cyclictest0-21swapper/222:58:442
218599140,3cyclictest0-21swapper/223:46:142
218599140,3cyclictest0-21swapper/222:49:082
218599140,2cyclictest0-21swapper/223:05:542
218599140,2cyclictest0-21swapper/200:13:432
218599140,13cyclictest0-21swapper/223:55:242
218599140,13cyclictest0-21swapper/221:51:332
218599140,13cyclictest0-21swapper/221:45:342
218599140,12cyclictest6675-21snmpd22:50:482
218599140,12cyclictest6675-21snmpd22:11:592
218599140,12cyclictest24471-21copy23:10:022
218599140,12cyclictest18511-21diskmemload22:36:452
218599140,12cyclictest0-21swapper/221:10:142
218399142,7cyclictest18511-21diskmemload22:55:001
218399142,7cyclictest0-21swapper/120:05:011
218399142,7cyclictest0-21swapper/119:45:011
218399141,11cyclictest6906-21df_inode20:40:131
218399141,11cyclictest22956-21munin-node1
2183991410,2cyclictest0-21swapper/123:39:561
218399140,12cyclictest18511-21diskmemload22:35:231
218399140,12cyclictest18511-21diskmemload00:31:321
218399140,12cyclictest12065-21runrttasks23:32:141
218399140,12cyclictest0-21swapper/122:04:531
218399140,12cyclictest0-21swapper/121:11:231
218399140,12cyclictest0-21swapper/100:15:321
218299141,6cyclictest0-21swapper/020:51:410
2182991410,2cyclictest0-21swapper/020:35:270
2188991310,2cyclictest0-21swapper/323:15:093
2188991310,2cyclictest0-21swapper/322:50:263
2188991310,2cyclictest0-21swapper/322:45:273
2188991310,2cyclictest0-21swapper/322:42:323
2188991310,2cyclictest0-21swapper/322:20:193
2188991310,2cyclictest0-21swapper/322:05:303
2188991310,2cyclictest0-21swapper/300:08:553
2188991310,2cyclictest0-21swapper/300:02:413
218899130,3cyclictest23156-21ssh23:07:383
218899130,2cyclictest0-21swapper/321:45:053
218899130,2cyclictest0-21swapper/300:11:413
218899130,12cyclictest13815-21ssh22:19:373
218899130,12cyclictest0-21swapper/323:03:423
218899130,12cyclictest0-21swapper/322:55:313
218899130,12cyclictest0-21swapper/321:50:423
218899130,12cyclictest0-21swapper/321:10:003
218899130,12cyclictest0-21swapper/300:22:323
218899130,11cyclictest0-21swapper/323:56:333
218599138,3cyclictest1877-21grep00:35:292
218599133,6cyclictest0-21swapper/219:10:242
2185991310,2cyclictest0-21swapper/223:42:392
2185991310,2cyclictest0-21swapper/223:16:012
2185991310,2cyclictest0-21swapper/200:21:012
218599130,2cyclictest18511-21diskmemload21:18:442
218599130,2cyclictest0-21swapper/223:32:072
218599130,2cyclictest0-21swapper/222:40:382
218599130,2cyclictest0-21swapper/222:30:542
218599130,12cyclictest0-21swapper/200:34:112
218599130,12cyclictest0-21swapper/200:26:142
218599130,11cyclictest6592-21sh20:40:122
218599130,11cyclictest18511-21diskmemload21:55:402
218599130,11cyclictest0-21swapper/223:00:232
218399139,2cyclictest0-21swapper/121:55:241
218399139,2cyclictest0-21swapper/100:25:211
218399132,7cyclictest0-21swapper/121:29:591
218399132,6cyclictest0-21swapper/100:04:591
218399131,6cyclictest0-21swapper/122:55:011
2183991310,2cyclictest0-21swapper/123:58:521
2183991310,2cyclictest0-21swapper/123:54:321
2183991310,2cyclictest0-21swapper/122:40:131
2183991310,2cyclictest0-21swapper/121:49:031
2183991310,2cyclictest0-21swapper/121:31:441
2183991310,2cyclictest0-21swapper/121:05:031
2183991310,2cyclictest0-21swapper/119:15:131
2183991310,2cyclictest0-21swapper/100:37:521
2183991310,2cyclictest0-21swapper/100:22:131
2183991310,2cyclictest0-21swapper/100:14:151
2183991310,2cyclictest0-21swapper/100:05:031
218399130,2cyclictest18511-21diskmemload23:45:561
218399130,2cyclictest18511-21diskmemload22:23:331
218399130,2cyclictest0-21swapper/123:04:101
218399130,11cyclictest0-21swapper/123:42:321
218399130,11cyclictest0-21swapper/123:25:191
218399130,11cyclictest0-21swapper/123:25:191
218399130,11cyclictest0-21swapper/122:05:231
218299130,2cyclictest0-21swapper/022:34:510
218899129,2cyclictest0-21swapper/322:35:073
218899129,2cyclictest0-21swapper/322:00:223
218899129,2cyclictest0-21swapper/300:15:023
218899123,3cyclictest30122-21timerwakeupswit20:15:283
218899122,7cyclictest0-21swapper/319:29:023
218899120,2cyclictest0-21swapper/320:25:183
218899120,11cyclictest0-21swapper/323:45:163
218899120,11cyclictest0-21swapper/319:20:173
218599129,2cyclictest0-21swapper/222:20:282
218599129,2cyclictest0-21swapper/222:05:342
218599122,7cyclictest0-21swapper/220:34:592
218599122,6cyclictest0-21swapper/219:15:252
218599120,2cyclictest0-21swapper/223:52:002
218599120,2cyclictest0-21swapper/219:30:122
218599120,2cyclictest0-21swapper/219:25:012
218599120,11cyclictest0-21swapper/221:05:302
218599120,11cyclictest0-21swapper/219:40:212
218599120,11cyclictest0-21swapper/219:35:112
218599120,11cyclictest0-21swapper/219:20:152
218399126,3cyclictest328750irq/24-eth121:20:121
218399122,6cyclictest0-21swapper/120:30:011
218399121,9cyclictest6356-21cat20:40:011
218399121,9cyclictest0-21swapper/120:15:221
218399121,3cyclictest0-21swapper/121:36:091
218399120,10cyclictest18511-21diskmemload22:13:471
218299129,2cyclictest0-21swapper/020:15:290
218299123,6cyclictest0-21swapper/021:20:240
218299122,7cyclictest0-21swapper/019:26:590
218299122,6cyclictest0-21swapper/020:21:360
218299122,6cyclictest0-21swapper/020:21:350
218299120,2cyclictest0-21swapper/019:15:170
218899118,2cyclictest0-21swapper/321:05:163
218899118,2cyclictest0-21swapper/320:46:313
218899112,6cyclictest0-21swapper/320:38:013
218599118,2cyclictest0-21swapper/221:00:172
218599118,2cyclictest0-21swapper/220:55:272
218599118,2cyclictest0-21swapper/219:50:172
218399118,2cyclictest0-21swapper/121:00:171
218399111,8cyclictest18630-21munin-node1
218399111,8cyclictest0-21swapper/120:10:181
218399111,8cyclictest0-21swapper/119:20:161
218399111,3cyclictest12653-21munin-node1
218399111,2cyclictest0-21swapper/119:30:101
218399110,9cyclictest0-21swapper/120:50:141
218399110,9cyclictest0-21swapper/119:55:121
218399110,9cyclictest0-21swapper/119:10:061
218299112,6cyclictest0-21swapper/021:06:580
218299111,6cyclictest0-21swapper/020:31:380
218299110,1cyclictest0-21swapper/020:05:130
218299110,10cyclictest0-21swapper/020:10:250
254932100,1sleep10-21swapper/120:05:171
241512100,1sleep30-21swapper/320:00:273
218899105,3cyclictest17567-21cut19:45:183
218899102,5cyclictest0-21swapper/320:10:593
218599107,2cyclictest0-21swapper/219:45:172
218599105,3cyclictest24932-21basename20:05:122
218599102,7cyclictest0-21swapper/220:16:592
218599102,6cyclictest0-21swapper/220:50:222
218599102,6cyclictest0-21swapper/220:48:592
218399105,3cyclictest1179-21ls20:25:161
218399100,8cyclictest0-21swapper/119:50:121
218399100,8cyclictest0-21swapper/119:25:141
218399100,2cyclictest0-21swapper/119:45:121
218299102,6cyclictest0-21swapper/020:56:430
218299100,8cyclictest0-21swapper/020:00:080
21889994,3cyclictest4717-21cut19:15:133
21889991,5cyclictest16517-21copy21:05:003
21889991,3cyclictest0-21swapper/319:30:153
21829996,2cyclictest0-21swapper/019:33:590
21829994,3cyclictest0-21swapper/020:26:290
21889983,3cyclictest12709-21telnet19:35:113
21859983,3cyclictest23080-21cpuspeed_turbos20:00:142
21859980,6cyclictest0-21swapper/219:55:242
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional