You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-05 - 04:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Mon Jan 05, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24667212094,21sleep00-21swapper/019:07:340
24712211896,16sleep30-21swapper/319:08:103
24623211796,16sleep20-21swapper/219:07:002
24526210997,6sleep10-21swapper/119:05:471
289462880,3sleep09-21ksoftirqd/020:40:000
99922710,0sleep10-21swapper/121:10:191
24885993215,16cyclictest0-21swapper/019:35:120
2488599220,19cyclictest0-21swapper/023:55:120
306842210,1sleep10-21swapper/123:27:591
306842210,1sleep10-21swapper/123:27:581
24887992117,2cyclictest0-21swapper/120:05:121
2488599210,19cyclictest0-21swapper/019:40:140
2488599200,19cyclictest0-21swapper/023:15:110
2488599200,18cyclictest0-21swapper/020:15:140
168222200,1sleep20-21swapper/221:19:132
2489199190,4cyclictest0-21swapper/300:26:053
2489199190,14cyclictest0-21swapper/323:56:043
2488599190,4cyclictest0-21swapper/021:54:040
2488599190,3cyclictest0-21swapper/022:09:040
253752180,1sleep011-21rcuc/021:29:120
24891991815,2cyclictest8485-21kworker/u8:121:08:053
24891991815,2cyclictest6876-21kworker/u8:019:49:043
24891991815,2cyclictest29673-21kworker/u8:122:17:053
2489199180,4cyclictest11046-21ssh22:27:043
2489199180,13cyclictest0-21swapper/320:33:053
2489199180,13cyclictest0-21swapper/319:33:053
24890991815,2cyclictest20317-21kworker/u8:222:45:052
2489099181,2cyclictest0-21swapper/222:27:042
2489099180,16cyclictest0-21swapper/222:04:042
2488599180,12cyclictest0-21swapper/023:44:050
24891991714,2cyclictest31827-21kworker/u8:123:08:053
24891991714,2cyclictest25208-21kworker/u8:120:52:053
24891991714,2cyclictest24776-21kworker/u8:121:33:053
24891991714,2cyclictest24651-21kworker/u8:023:21:053
24891991714,2cyclictest20317-21kworker/u8:222:44:053
24891991714,2cyclictest18645-21kworker/u8:020:48:043
24891991714,2cyclictest18645-21kworker/u8:020:36:043
24891991714,2cyclictest17331-21kworker/u8:223:13:053
24891991714,2cyclictest15108-21kworker/u8:220:15:053
24891991714,2cyclictest14529-21kworker/u8:121:55:043
24891991714,2cyclictest10649-21kworker/u8:123:51:043
2489199171,3cyclictest0-21swapper/300:35:203
2489199171,14cyclictest2221-21apt-get21:40:123
2489199170,2cyclictest0-21swapper/321:21:053
24890991713,2cyclictest29882-21kworker/u8:000:13:042
24890991712,3cyclictest5761-21rsyslogd19:44:592
24890991711,5cyclictest0-21swapper/221:41:042
2489099170,15cyclictest0-21swapper/223:00:112
24891991613,2cyclictest8485-21kworker/u8:121:18:053
24891991613,2cyclictest6876-21kworker/u8:019:55:053
24891991613,2cyclictest31827-21kworker/u8:123:04:043
24891991613,2cyclictest3052-21kworker/u8:219:22:043
24891991613,2cyclictest25885-21kworker/u8:022:59:053
24891991613,2cyclictest25208-21kworker/u8:120:42:053
24891991613,2cyclictest21857-21kworker/u8:000:34:053
24891991613,2cyclictest21304-21kworker/u8:200:03:043
24891991613,2cyclictest18971-21kworker/u8:022:00:043
24891991613,2cyclictest15108-21kworker/u8:220:29:053
24891991613,2cyclictest12468-21kworker/u8:023:15:053
24891991613,2cyclictest11002-21kworker/u8:120:06:053
24891991613,2cyclictest11002-21kworker/u8:120:02:053
2489199161,13cyclictest5348-21hddtemp_smartct19:40:173
2489199160,2cyclictest0-21swapper/321:37:033
2489199160,2cyclictest0-21swapper/321:26:053
2489099162,2cyclictest0-21swapper/221:12:052
24890991613,2cyclictest2317-21kworker/u8:022:21:052
24890991613,2cyclictest12468-21kworker/u8:023:10:052
2489099161,2cyclictest32069-21apt-get23:30:112
24890991612,2cyclictest0-21swapper/223:45:012
2489099160,14cyclictest0-21swapper/223:15:112
24887991611,3cyclictest9076-21fschecks_count22:25:151
2488799160,14cyclictest0-21swapper/100:20:061
160792160,1sleep2301ktimersoftd/222:33:292
24891991512,2cyclictest733-21kworker/u8:220:56:053
24891991512,2cyclictest6876-21kworker/u8:019:52:053
24891991512,2cyclictest29882-21kworker/u8:000:14:043
24891991512,2cyclictest24651-21kworker/u8:023:28:053
24891991512,2cyclictest24651-21kworker/u8:023:28:043
24891991512,2cyclictest2205-21kworker/u8:219:36:053
24891991510,3cyclictest26636-21memory22:45:183
2489199150,3cyclictest0-21swapper/323:45:163
2489199150,13cyclictest0-21swapper/323:40:133
2489199150,13cyclictest0-21swapper/322:51:213
2489199150,13cyclictest0-21swapper/300:17:523
24890991512,2cyclictest9558-21kworker/u8:222:12:052
24890991512,2cyclictest26752-21kworker/u8:119:44:052
24890991512,2cyclictest24776-21kworker/u8:121:47:052
24890991512,2cyclictest18645-21kworker/u8:020:47:052
24890991512,2cyclictest13243-21kworker/u8:221:25:042
24890991512,2cyclictest10649-21kworker/u8:100:08:052
2489099150,2cyclictest0-21swapper/200:02:052
2489099150,13cyclictest0-21swapper/223:45:112
2489099150,13cyclictest0-21swapper/222:51:282
2489099150,10cyclictest0-21swapper/221:07:052
2488799151,12cyclictest27818-21irqstats19:15:191
2488799151,12cyclictest17204-21apt-get22:35:121
24887991510,3cyclictest0-21swapper/122:43:531
2488799150,3cyclictest22918-21latency_hist00:35:001
2488799150,3cyclictest0-21swapper/122:20:151
2488799150,13cyclictest0-21swapper/123:05:161
24885991512,2cyclictest3908-21ssh22:56:140
2488599150,13cyclictest8724-21diskmemload00:35:130
2488599150,10cyclictest0-21swapper/000:00:040
24891991411,2cyclictest13837-21kworker/u8:122:31:043
24891991410,2cyclictest0-21swapper/322:20:253
2489199140,2cyclictest0-21swapper/322:14:043
2489199140,2cyclictest0-21swapper/321:53:053
2489199140,13cyclictest0-21swapper/300:21:013
2489199140,12cyclictest0-21swapper/321:10:263
2489099149,3cyclictest19256-21sshd23:51:512
24890991411,2cyclictest5613-21kworker/u8:200:20:042
24890991411,2cyclictest30950-21kworker/u8:019:25:042
24890991411,2cyclictest15108-21kworker/u8:220:21:052
2489099140,2cyclictest0-21swapper/200:26:052
2489099140,12cyclictest8724-21diskmemload00:35:352
2488799149,3cyclictest14659-21ssh22:30:491
2488799142,6cyclictest0-21swapper/121:00:011
2488799142,10cyclictest20403-21taskset23:15:251
24887991411,2cyclictest0-21swapper/123:30:561
24887991411,2cyclictest0-21swapper/122:47:361
2488799140,12cyclictest8724-21diskmemload22:05:211
2488799140,12cyclictest6675-21snmpd21:55:211
2488799140,12cyclictest0-21swapper/121:49:551
2488799140,12cyclictest0-21swapper/121:18:211
2488599140,12cyclictest0-21swapper/023:45:190
2488599140,12cyclictest0-21swapper/022:43:130
2488599140,12cyclictest0-21swapper/021:20:550
24891991310,2cyclictest0-21swapper/323:33:113
24891991310,2cyclictest0-21swapper/321:00:153
24891991310,2cyclictest0-21swapper/320:20:303
2489199130,2cyclictest0-21swapper/300:06:303
2489199130,1cyclictest0-21swapper/320:10:213
2489199130,11cyclictest8724-21diskmemload23:35:513
2489199130,11cyclictest0-21swapper/322:05:253
2489099138,3cyclictest0-21swapper/223:55:262
24890991310,2cyclictest3052-21kworker/u8:219:17:052
24890991310,2cyclictest26752-21kworker/u8:119:13:042
24890991310,2cyclictest25885-21kworker/u8:022:56:052
24890991310,2cyclictest17093-21ssh22:35:032
24890991310,2cyclictest11002-21kworker/u8:120:08:052
24890991310,2cyclictest11002-21kworker/u8:120:01:042
24890991310,2cyclictest0-21swapper/223:29:262
24890991310,2cyclictest0-21swapper/223:29:252
24890991310,2cyclictest0-21swapper/223:05:162
24890991310,2cyclictest0-21swapper/221:36:342
24890991310,2cyclictest0-21swapper/221:00:302
2489099130,9cyclictest0-21swapper/220:58:052
2489099130,2cyclictest0-21swapper/223:37:252
2489099130,2cyclictest0-21swapper/221:56:052
2489099130,2cyclictest0-21swapper/221:50:122
2489099130,2cyclictest0-21swapper/200:31:052
2489099130,12cyclictest0-21swapper/222:05:152
2489099130,12cyclictest0-21swapper/219:50:172
2489099130,12cyclictest0-21swapper/200:15:192
2489099130,11cyclictest30133-21pzem_current20:40:202
2489099130,11cyclictest0-21swapper/220:50:162
2488799132,6cyclictest0-21swapper/120:35:001
2488799132,6cyclictest0-21swapper/120:15:001
24887991310,2cyclictest0-21swapper/121:54:351
24887991310,2cyclictest0-21swapper/100:25:351
2488799130,2cyclictest8724-21diskmemload21:25:261
2488799130,2cyclictest0-21swapper/119:45:101
2488799130,2cyclictest0-21swapper/119:10:151
2488799130,2cyclictest0-21swapper/100:05:011
2488799130,2cyclictest0-21swapper/100:04:371
2488799130,12cyclictest0-21swapper/123:38:051
2488799130,12cyclictest0-21swapper/121:42:061
2488799130,12cyclictest0-21swapper/120:40:271
2488799130,11cyclictest8724-21diskmemload23:55:081
2488799130,11cyclictest8724-21diskmemload23:52:191
2488799130,11cyclictest8724-21diskmemload21:24:021
2488799130,11cyclictest4863-21ssh00:13:291
2488799130,11cyclictest0-21swapper/123:00:521
2488799130,11cyclictest0-21swapper/122:11:551
2488799130,11cyclictest0-21swapper/100:37:461
2488799130,10cyclictest0-21swapper/123:40:131
24885991310,2cyclictest0-21swapper/022:26:150
24885991310,2cyclictest0-21swapper/021:17:220
2488599130,11cyclictest6675-21snmpd00:26:240
2488599130,11cyclictest0-21swapper/022:10:180
2488599130,11cyclictest0-21swapper/020:50:160
2488599130,11cyclictest0-21swapper/020:40:130
89652121,7sleep08750-21apt-get19:50:040
281042120,1sleep00-21swapper/022:46:550
2489199120,2cyclictest0-21swapper/321:46:053
2489199120,2cyclictest0-21swapper/319:25:003
2489199120,2cyclictest0-21swapper/319:18:053
2489199120,11cyclictest16929-21copy22:35:003
2489099129,2cyclictest26752-21kworker/u8:119:31:052
2489099129,2cyclictest0-21swapper/221:30:502
2489099127,3cyclictest21859-21sh22:40:162
2489099122,7cyclictest0-21swapper/219:59:592
2489099120,11cyclictest0-21swapper/223:20:192
2489099120,11cyclictest0-21swapper/222:15:022
2489099120,11cyclictest0-21swapper/221:21:052
2488799129,2cyclictest0-21swapper/123:45:011
2488799129,2cyclictest0-21swapper/123:10:011
2488799127,3cyclictest0-21swapper/122:50:241
2488799127,3cyclictest0-21swapper/119:25:231
2488799122,7cyclictest0-21swapper/119:52:591
2488799122,5cyclictest0-21swapper/121:00:001
2488799120,2cyclictest0-21swapper/122:00:461
2488799120,2cyclictest0-21swapper/121:35:071
2488799120,11cyclictest0-21swapper/123:21:061
2488799120,11cyclictest0-21swapper/122:55:101
2488799120,10cyclictest0-21swapper/121:30:221
2488799120,10cyclictest0-21swapper/120:50:201
2488599129,2cyclictest8724-21diskmemload23:05:130
2488599129,2cyclictest0-21swapper/023:04:350
2488599129,2cyclictest0-21swapper/021:35:140
2488599129,2cyclictest0-21swapper/021:10:040
2488599129,2cyclictest0-21swapper/000:12:230
2488599122,7cyclictest0-21swapper/021:46:590
2488599122,7cyclictest0-21swapper/019:58:020
2488599120,2cyclictest0-21swapper/023:27:550
2488599120,2cyclictest0-21swapper/023:27:540
2488599120,2cyclictest0-21swapper/022:30:230
2488599120,2cyclictest0-21swapper/000:08:550
2488599120,11cyclictest0-21swapper/023:35:440
2488599120,11cyclictest0-21swapper/023:21:540
2488599120,11cyclictest0-21swapper/022:00:440
2489199110,2cyclictest0-21swapper/319:12:513
2489099118,2cyclictest0-21swapper/219:35:142
2489099116,3cyclictest6528-21ntpd20:10:142
2489099113,6cyclictest0-21swapper/220:35:232
2488799118,2cyclictest0-21swapper/100:15:391
2488799117,2cyclictest13035-21apt-get20:00:121
2488799116,3cyclictest494-21cat20:50:001
2488799116,3cyclictest4769-21munin-node1
2488799116,3cyclictest2734-21munin-node1
2488799111,8cyclictest0-21swapper/119:55:291
2488799111,3cyclictest0-21swapper/120:20:181
2488799111,2cyclictest23095-21apt-get20:25:111
2488799110,9cyclictest27113-21munin-node1
2488799110,1cyclictest0-21swapper/122:18:161
2488599118,2cyclictest8724-21diskmemload22:51:240
2488599118,2cyclictest8724-21diskmemload22:37:340
2488599118,2cyclictest8724-21diskmemload22:22:040
2488599118,2cyclictest1414-21ssh22:15:280
2488599118,2cyclictest0-21swapper/023:50:450
2488599118,2cyclictest0-21swapper/023:10:140
2488599118,2cyclictest0-21swapper/019:20:180
2488599118,2cyclictest0-21swapper/000:15:150
2488599112,6cyclictest0-21swapper/021:55:020
2488599112,6cyclictest0-21swapper/021:08:590
2488599112,6cyclictest0-21swapper/020:33:020
2488599112,6cyclictest0-21swapper/020:20:590
2488599112,6cyclictest0-21swapper/019:48:590
2488599110,2cyclictest0-21swapper/020:10:210
2488599110,2cyclictest0-21swapper/000:31:550
2489099105,3cyclictest0-21swapper/219:20:132
2489099104,4cyclictest19629-21tr20:15:182
2489099102,6cyclictest0-21swapper/220:30:252
2489099102,6cyclictest0-21swapper/220:25:242
2488799107,2cyclictest0-21swapper/119:20:171
2488799105,3cyclictest765-21basename19:30:131
2488799102,6cyclictest0-21swapper/121:05:111
2488799100,8cyclictest0-21swapper/120:15:161
2488599107,2cyclictest0-21swapper/023:30:440
2488599107,2cyclictest0-21swapper/021:40:440
2488599105,3cyclictest23946-21sed20:25:170
2488599102,6cyclictest0-21swapper/020:55:090
2488599102,6cyclictest0-21swapper/020:45:230
2488599102,6cyclictest0-21swapper/019:29:520
2488599100,9cyclictest5613-21kworker/u8:200:21:040
248859996,2cyclictest8724-21diskmemload21:30:220
248859992,6cyclictest0-21swapper/021:04:590
248859992,5cyclictest0-21swapper/020:06:590
248859991,6cyclictest0-21swapper/020:00:250
248859990,2cyclictest0-21swapper/019:10:030
248859980,7cyclictest0-21swapper/019:17:590
248859973,3cyclictest721-21chrt19:30:090
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional