You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-25 - 20:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Thu Dec 25, 2025 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6302211995,18sleep30-21swapper/307:07:513
6199211594,16sleep00-21swapper/007:06:310
6301210695,6sleep20-21swapper/207:07:502
6437210594,6sleep10-21swapper/107:09:291
88712840,1sleep30-21swapper/308:34:593
221542810,1sleep30-21swapper/307:45:233
272672710,1sleep20-21swapper/212:20:532
222382600,1sleep20-21swapper/211:38:472
651499360,18cyclictest0-21swapper/210:25:102
6515993015,13cyclictest0-21swapper/309:40:123
244282240,3sleep121-21rcuc/109:10:231
651399230,21cyclictest0-21swapper/108:30:101
651299230,3cyclictest8863-21ssh12:37:460
651299230,3cyclictest28687-21grep09:15:250
651299230,3cyclictest23555-21ssh09:47:250
651299230,3cyclictest20243-21timerwakeupswit10:20:300
651299230,3cyclictest0-21swapper/010:33:050
651299230,2cyclictest0-21swapper/008:20:140
651299220,3cyclictest31933-21aten2.4_r3power11:50:130
651299220,3cyclictest28481-21ssh09:53:330
651299220,3cyclictest25542-21tr11:05:130
651299220,3cyclictest24061-21ssh10:25:170
651299220,3cyclictest199902sleep011:35:210
651299220,3cyclictest19074-21ssh09:42:010
651299220,3cyclictest18653-21latency_hist10:20:010
651299220,3cyclictest14429-21sh10:51:250
651299220,3cyclictest0-21swapper/012:23:530
651299220,3cyclictest0-21swapper/012:06:050
651299220,3cyclictest0-21swapper/011:33:050
651299220,3cyclictest0-21swapper/010:46:500
651299220,3cyclictest0-21swapper/010:11:010
651299220,3cyclictest0-21swapper/010:02:210
651299220,3cyclictest0-21swapper/009:57:020
651299220,3cyclictest0-21swapper/009:10:530
651299220,2cyclictest23001-21diskmemload10:05:130
651299220,2cyclictest0-21swapper/012:10:180
651299220,2cyclictest0-21swapper/010:57:060
651299220,12cyclictest0-21swapper/009:34:030
651399210,19cyclictest0-21swapper/107:25:111
651299210,3cyclictest7266-21fschecks_count07:10:130
651299210,3cyclictest31416-21ssh12:25:410
651299210,3cyclictest29585-21ssh11:46:210
651299210,3cyclictest24346-21sed07:50:250
651299210,3cyclictest12708-21cpuspeed_turbos09:35:130
651299210,3cyclictest0-21swapper/012:34:410
651299210,3cyclictest0-21swapper/012:01:570
651299210,3cyclictest0-21swapper/011:25:210
651299210,3cyclictest0-21swapper/010:40:130
651299210,2cyclictest6864-21nscd09:24:050
651299210,2cyclictest23001-21diskmemload10:35:370
651299210,2cyclictest0-21swapper/012:18:290
651299210,2cyclictest0-21swapper/011:42:130
651299210,2cyclictest0-21swapper/011:24:010
651299210,2cyclictest0-21swapper/011:19:130
651299210,2cyclictest0-21swapper/009:26:530
651299210,2cyclictest0-21swapper/007:35:050
6514992017,2cyclictest23170-21kworker/u8:211:43:042
6514992017,2cyclictest1497-21kworker/u8:110:36:042
651299200,3cyclictest26674-40update-apt-xapi07:55:330
651299200,2cyclictest23001-21diskmemload11:00:010
651299200,2cyclictest0-21swapper/011:58:570
651299200,2cyclictest0-21swapper/011:12:180
6514991916,2cyclictest31678-21kworker/u8:109:22:042
6514991916,2cyclictest20142-21kworker/u8:112:18:042
6514991916,2cyclictest14332-21kworker/u8:212:10:042
651499190,17cyclictest0-21swapper/207:10:102
651399190,17cyclictest0-21swapper/111:05:111
651299191,12cyclictest0-21swapper/008:20:010
651299190,2cyclictest0-21swapper/007:45:170
117552190,1sleep10-21swapper/110:10:281
6514991815,2cyclictest8480-21kworker/u8:010:13:042
6514991815,2cyclictest8480-21kworker/u8:010:08:052
6514991815,2cyclictest4953-21kworker/u8:008:45:032
6514991815,2cyclictest3791-21kworker/u8:009:46:052
6514991815,2cyclictest29626-21kworker/u8:211:15:032
6514991815,2cyclictest25637-21kworker/u8:012:26:042
6514991815,2cyclictest24617-21kworker/u8:007:54:052
6514991815,2cyclictest2320-21kworker/u8:007:19:042
6514991815,2cyclictest2320-21kworker/u8:007:19:042
6514991815,2cyclictest1703-21kworker/u8:210:43:042
6514991815,2cyclictest10193-21kworker/u8:111:29:032
6514991814,2cyclictest3840-21kworker/u8:011:20:052
651299180,2cyclictest12982-21copy08:45:010
651299180,2cyclictest0-21swapper/009:05:260
651299180,2cyclictest0-21swapper/008:05:420
651599171,3cyclictest7429-21users10:05:293
6514991714,2cyclictest5451-21kworker/u8:012:36:042
6514991714,2cyclictest3791-21kworker/u8:009:36:042
6514991714,2cyclictest31678-21kworker/u8:109:29:032
6514991714,2cyclictest27967-21kworker/u8:108:02:042
6514991714,2cyclictest20938-21kworker/u8:011:05:032
6514991714,2cyclictest19001-21kworker/u8:010:22:042
6514991714,2cyclictest14332-21kworker/u8:212:09:042
6514991714,2cyclictest10324-21kworker/u8:207:29:052
6514991714,2cyclictest10193-21kworker/u8:111:59:042
651299170,2cyclictest0-21swapper/008:27:570
651299170,2cyclictest0-21swapper/008:01:290
6514991613,2cyclictest910-21kworker/u8:208:22:042
6514991613,2cyclictest4953-21kworker/u8:009:09:032
6514991613,2cyclictest4953-21kworker/u8:008:42:042
6514991613,2cyclictest4953-21kworker/u8:008:28:042
6514991613,2cyclictest29626-21kworker/u8:211:31:042
6514991613,2cyclictest25046-21kworker/u8:210:31:052
6514991613,2cyclictest23932-21kworker/u8:209:57:042
6514991613,2cyclictest21338-21kworker/u8:109:11:032
6514991613,2cyclictest14223-21kworker/u8:110:58:052
6514991613,2cyclictest12-21rcu_preempt09:30:122
651399161,13cyclictest0-21swapper/107:45:171
651399160,3cyclictest24594-21sshd11:04:181
651299161,4cyclictest15519-21grep07:30:170
651299161,4cyclictest0-21swapper/007:20:160
651299161,3cyclictest9842-21cat08:35:140
651599151,12cyclictest5575-21munin-run12:35:003
651599151,12cyclictest2101-21irqstats11:15:173
651599151,12cyclictest14101-21ssh09:35:423
6515991510,3cyclictest23001-21diskmemload11:05:143
6515991510,3cyclictest0-21swapper/312:08:383
651599150,13cyclictest1093-21diskmemload12:29:393
651599150,13cyclictest0-21swapper/312:10:103
651599150,13cyclictest0-21swapper/311:35:143
651599150,13cyclictest0-21swapper/310:37:493
651599150,13cyclictest0-21swapper/309:54:593
651599150,13cyclictest0-21swapper/309:25:283
651599150,13cyclictest0-21swapper/309:12:083
651599150,13cyclictest0-21swapper/307:20:143
6514991512,2cyclictest910-21kworker/u8:208:38:042
6514991512,2cyclictest4953-21kworker/u8:009:00:042
6514991512,2cyclictest4953-21kworker/u8:008:32:042
6514991512,2cyclictest11021-21kworker/u8:209:40:052
6514991512,2cyclictest10193-21kworker/u8:111:51:032
6514991512,2cyclictest1000-21kworker/u8:112:30:042
6514991510,3cyclictest10899-21munin-node2
651399151,3cyclictest9961-21ssh12:00:441
651399151,3cyclictest28655-21cut11:45:221
6513991510,3cyclictest20863-21munin-run12:15:011
651399150,13cyclictest23001-21diskmemload10:00:191
651399150,13cyclictest15756-21which11:30:231
651399150,13cyclictest0-21swapper/112:25:131
651399150,13cyclictest0-21swapper/111:55:101
651299154,9cyclictest15268-21aten2.4_r3power08:50:120
651299152,7cyclictest0-21swapper/007:40:010
651299152,3cyclictest19185-21latency_hist09:00:000
651299151,4cyclictest9388-21tune2fs07:15:150
651299151,4cyclictest9388-21tune2fs07:15:140
651299151,4cyclictest7458-21runrttasks08:30:120
651299151,4cyclictest31360-21telnet08:10:120
651299151,4cyclictest17436-21tr08:55:130
651299151,3cyclictest13277-21grep07:25:130
651299151,3cyclictest0-21swapper/008:40:140
6515991411,2cyclictest0-21swapper/310:34:033
6515991411,2cyclictest0-21swapper/309:46:133
6515991411,2cyclictest0-21swapper/309:24:183
6515991410,2cyclictest19434-21munin-node3
651599140,3cyclictest23513-21df_abs10:25:123
651599140,2cyclictest0-21swapper/311:27:493
651599140,2cyclictest0-21swapper/311:13:483
651599140,2cyclictest0-21swapper/311:00:193
651599140,12cyclictest16640-21ssh10:55:093
651599140,12cyclictest0-21swapper/312:16:253
651599140,12cyclictest0-21swapper/312:03:413
651599140,12cyclictest0-21swapper/311:55:123
651599140,12cyclictest0-21swapper/311:20:053
651599140,12cyclictest0-21swapper/310:53:283
651599140,12cyclictest0-21swapper/310:41:313
651599140,12cyclictest0-21swapper/310:21:163
6514991411,2cyclictest27967-21kworker/u8:108:08:042
6514991411,2cyclictest18672-21kworker/u8:207:56:042
6514991411,2cyclictest1497-21kworker/u8:110:01:042
6514991411,2cyclictest12548-21kworker/u8:107:49:042
6514991411,2cyclictest12548-21kworker/u8:107:41:032
651499140,13cyclictest0-21swapper/211:12:562
651399149,3cyclictest6377-21hddtemp_smartct10:05:161
6513991411,2cyclictest0-21swapper/111:29:091
6513991411,2cyclictest0-21swapper/109:35:351
651399141,11cyclictest0-21swapper/109:50:191
651399140,3cyclictest28673-21switchtime10:30:271
651399140,3cyclictest0-21swapper/108:25:141
651399140,2cyclictest23001-21diskmemload09:48:271
651399140,2cyclictest0-21swapper/110:16:491
651399140,2cyclictest0-21swapper/107:30:271
651399140,12cyclictest23001-21diskmemload11:35:191
651399140,12cyclictest23001-21diskmemload10:37:391
651399140,12cyclictest23001-21diskmemload10:28:041
651399140,12cyclictest23001-21diskmemload09:57:001
651399140,12cyclictest0-21swapper/112:37:251
651399140,12cyclictest0-21swapper/111:50:141
651399140,12cyclictest0-21swapper/111:19:121
651399140,12cyclictest0-21swapper/110:23:441
97582130,3sleep10-21swapper/108:35:141
651599138,3cyclictest0-21swapper/310:10:153
651599134,6cyclictest0-21swapper/308:56:583
6515991310,2cyclictest0-21swapper/312:35:303
6515991310,2cyclictest0-21swapper/311:31:333
6515991310,2cyclictest0-21swapper/309:05:093
651599130,2cyclictest15558-21ssh10:15:193
651599130,2cyclictest0-21swapper/310:01:203
651599130,2cyclictest0-21swapper/309:55:093
651599130,2cyclictest0-21swapper/309:15:133
651599130,12cyclictest0-21swapper/312:20:093
651599130,12cyclictest0-21swapper/311:45:553
651599130,11cyclictest0-21swapper/307:25:123
6514991310,2cyclictest27967-21kworker/u8:108:13:032
6514991310,2cyclictest14981-21kworker/u8:007:36:042
6514991310,2cyclictest12548-21kworker/u8:107:31:032
6514991310,2cyclictest0-21swapper/211:46:072
6514991310,2cyclictest0-21swapper/208:55:162
651499130,2cyclictest0-21swapper/211:00:042
651499130,2cyclictest0-21swapper/209:17:172
651399133,3cyclictest11470-21kworker/1:010:50:131
6513991310,2cyclictest23001-21diskmemload12:20:231
6513991310,2cyclictest0-21swapper/112:34:431
6513991310,2cyclictest0-21swapper/112:15:201
6513991310,2cyclictest0-21swapper/111:22:151
6513991310,2cyclictest0-21swapper/111:11:211
6513991310,2cyclictest0-21swapper/110:48:321
6513991310,2cyclictest0-21swapper/110:42:441
6513991310,2cyclictest0-21swapper/109:29:071
6513991310,2cyclictest0-21swapper/109:22:331
6513991310,2cyclictest0-21swapper/109:15:141
6513991310,2cyclictest0-21swapper/108:15:201
6513991310,2cyclictest0-21swapper/108:05:191
6513991310,2cyclictest0-21swapper/107:15:131
6513991310,2cyclictest0-21swapper/107:15:121
651399130,2cyclictest23001-21diskmemload09:40:231
651399130,2cyclictest0-21swapper/109:32:521
651399130,2cyclictest0-21swapper/107:55:231
651399130,12cyclictest0-21swapper/112:07:451
651399130,12cyclictest0-21swapper/108:20:171
651399130,11cyclictest0-21swapper/110:56:171
651399130,11cyclictest0-21swapper/108:45:181
79492120,2sleep20-21swapper/210:45:052
651599129,2cyclictest23001-21diskmemload09:30:133
651599129,2cyclictest0-21swapper/311:40:133
651599129,2cyclictest0-21swapper/310:45:233
651599128,2cyclictest19592-21df_inode09:00:123
651599127,3cyclictest5800-21ntp_states08:25:173
651599127,3cyclictest25503-21fschecks_count07:55:123
651599120,2cyclictest0-21swapper/311:50:003
651599120,2cyclictest0-21swapper/308:10:223
651599120,2cyclictest0-21swapper/307:50:133
651599120,2cyclictest0-21swapper/307:15:153
651599120,2cyclictest0-21swapper/307:15:153
651599120,11cyclictest0-21swapper/308:20:163
651599120,11cyclictest0-21swapper/308:15:153
651499129,2cyclictest4953-21kworker/u8:008:52:052
651499120,2cyclictest0-21swapper/212:00:572
651499120,11cyclictest0-21swapper/210:16:172
651499120,11cyclictest0-21swapper/208:15:182
651399127,3cyclictest0-21swapper/109:05:121
651399122,7cyclictest0-21swapper/108:11:011
651399121,9cyclictest0-21swapper/107:50:251
651399121,3cyclictest0-21swapper/107:25:001
6513991210,1cyclictest0-21swapper/107:35:061
651399120,11cyclictest0-21swapper/108:55:111
651399120,10cyclictest23001-21diskmemload11:40:101
651599118,2cyclictest0-21swapper/308:00:273
651599116,3cyclictest17071-21aten2.4_r3power07:35:133
651599112,6cyclictest0-21swapper/308:36:583
651499118,2cyclictest0-21swapper/210:50:112
651499118,2cyclictest0-21swapper/209:50:462
651399117,2cyclictest27316-21sh08:00:131
651399111,3cyclictest0-21swapper/108:40:251
651399111,3cyclictest0-21swapper/107:40:111
651399110,9cyclictest0-21swapper/108:50:161
651399110,9cyclictest0-21swapper/107:10:221
651599102,5cyclictest0-21swapper/308:54:593
651599100,7cyclictest0-21swapper/308:45:583
651599100,7cyclictest0-21swapper/307:31:583
112292100,1sleep30-21swapper/308:40:133
65159994,3cyclictest8746-21sort07:15:003
65139990,8cyclictest0-21swapper/109:00:131
65159983,3cyclictest29284-21munin-node3
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional