You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-09 - 06:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Fri Jan 09, 2026 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3071521190,0sleep00-21swapper/019:15:000
28324211996,18sleep00-21swapper/019:06:070
28624211595,15sleep20-21swapper/219:09:582
285512113102,6sleep30-21swapper/319:09:033
283302113102,6sleep10-21swapper/119:06:121
314242780,1sleep30-21swapper/323:20:123
295352730,0sleep30-21swapper/322:05:133
179242730,0sleep10-21swapper/123:40:581
2865799361,33cyclictest0-21swapper/123:00:101
112202270,0sleep30-21swapper/300:10:193
123682250,0sleep30-21swapper/322:21:443
2865999237,14cyclictest0-21swapper/319:50:123
2865999211,3cyclictest7328-21ssh23:30:113
2865799210,19cyclictest0-21swapper/119:50:121
220822210,0sleep00-21swapper/023:10:110
136242190,1sleep013627-21needreboot19:50:170
28658991714,2cyclictest4708-21kworker/u8:300:16:052
28658991713,2cyclictest28574-21kworker/u8:119:10:052
2865899171,14cyclictest12510-21diskmemload22:55:112
28657991712,3cyclictest0-21swapper/120:00:131
2865699171,14cyclictest12834-21turbostat23:00:000
2865999161,13cyclictest0-21swapper/300:20:133
2865999160,14cyclictest31353-21ssh00:33:393
28658991613,2cyclictest4708-21kworker/u8:300:23:052
28658991613,2cyclictest24869-21kworker/u8:022:04:052
2865799161,13cyclictest0-21swapper/121:35:171
2865999152,11cyclictest0-21swapper/319:35:593
28659991512,2cyclictest0-21swapper/321:11:283
28659991510,3cyclictest0-21swapper/321:29:473
2865999150,13cyclictest18961-21ssh21:15:583
2865999150,13cyclictest17096-21ssh22:27:163
2865999150,13cyclictest12510-21diskmemload22:40:083
28658991512,2cyclictest25106-21kworker/u8:121:32:052
28658991512,2cyclictest17689-21kworker/u8:023:42:052
2865899151,12cyclictest12510-21diskmemload22:25:152
2865899151,12cyclictest0-21swapper/223:37:052
2865899150,3cyclictest23018-21timerwakeupswit21:20:252
2865899150,3cyclictest0-21swapper/200:10:002
2865799151,3cyclictest0-21swapper/123:10:201
2865799151,12cyclictest30692-21munin-run20:35:001
2865799150,13cyclictest2488-21latency_hist19:25:001
28656991512,2cyclictest0-21swapper/022:23:000
28656991511,2cyclictest15645-21munin-run21:50:000
28656991511,2cyclictest15645-21munin-run21:50:000
28656991510,3cyclictest30582-21sh00:32:160
2865699150,13cyclictest4808-21ssh22:14:200
2865999149,3cyclictest5505-21ssh22:15:123
2865999149,3cyclictest23859-21ssh23:48:383
2865999149,3cyclictest0-21swapper/322:30:163
2865999148,4cyclictest0-21swapper/300:05:103
2865999142,7cyclictest309-21copy19:20:003
28659991411,2cyclictest12510-21diskmemload22:10:203
28659991411,2cyclictest0-21swapper/322:00:583
2865999140,2cyclictest12510-21diskmemload23:53:383
2865999140,2cyclictest0-21swapper/323:57:483
2865999140,13cyclictest0-21swapper/323:13:173
2865999140,12cyclictest12510-21diskmemload21:33:353
2865999140,12cyclictest0-21swapper/323:25:163
2865999140,12cyclictest0-21swapper/321:22:183
28658991411,2cyclictest12082-21kworker/u8:019:20:052
2865899140,2cyclictest0-21swapper/221:10:242
2865899140,13cyclictest0-21swapper/221:48:212
2865899140,13cyclictest0-21swapper/221:48:212
2865899140,13cyclictest0-21swapper/200:40:002
2865899140,12cyclictest7306-21munin-node2
2865899140,12cyclictest12510-21diskmemload22:46:412
2865899140,12cyclictest0-21swapper/223:09:042
2865899140,12cyclictest0-21swapper/222:44:112
2865799142,6cyclictest0-21swapper/120:25:001
28657991410,2cyclictest0-21swapper/123:48:071
2865799140,13cyclictest0-21swapper/121:55:131
2865799140,12cyclictest2523-21munin-node1
2865799140,12cyclictest12510-21diskmemload22:10:421
2865799140,12cyclictest12510-21diskmemload00:09:031
2865799140,12cyclictest0-21swapper/122:30:231
28656991411,2cyclictest17689-21kworker/u8:023:47:050
28656991411,2cyclictest0-21swapper/023:32:200
28656991411,2cyclictest0-21swapper/022:06:000
28656991411,2cyclictest0-21swapper/000:05:080
2865699140,2cyclictest17880-21ssh22:28:390
2865699140,2cyclictest12510-21diskmemload00:16:470
2865699140,2cyclictest0-21swapper/021:27:390
2865699140,2cyclictest0-21swapper/021:11:190
2865699140,13cyclictest12510-21diskmemload21:20:590
2865699140,13cyclictest0-21swapper/000:01:200
2865699140,12cyclictest0-21swapper/022:41:170
2865699140,12cyclictest0-21swapper/022:31:050
2865699140,12cyclictest0-21swapper/021:58:380
2865699140,12cyclictest0-21swapper/000:39:080
189662140,2sleep10-21swapper/121:53:051
46292130,2sleep20-21swapper/221:36:352
2865999132,6cyclictest0-21swapper/320:55:003
28659991310,2cyclictest0-21swapper/323:17:033
28659991310,2cyclictest0-21swapper/322:52:103
28659991310,2cyclictest0-21swapper/322:36:183
28659991310,2cyclictest0-21swapper/320:35:233
2865999130,3cyclictest4532-21ssh00:03:293
2865999130,2cyclictest23008-21ssh21:57:223
2865999130,2cyclictest0-21swapper/322:55:583
2865999130,2cyclictest0-21swapper/300:25:123
2865999130,12cyclictest0-21swapper/323:35:113
2865999130,12cyclictest0-21swapper/323:00:083
2865999130,12cyclictest0-21swapper/321:50:263
2865999130,12cyclictest0-21swapper/300:17:593
2865999130,11cyclictest0-21swapper/322:48:593
28658991310,2cyclictest28574-21kworker/u8:119:28:052
28658991310,2cyclictest24126-21kworker/u8:123:55:052
28658991310,2cyclictest13517-21kworker/u8:100:27:032
28658991310,2cyclictest12328-21kworker/u8:219:53:052
28658991310,2cyclictest0-21swapper/223:04:042
28658991310,2cyclictest0-21swapper/221:58:402
28658991310,2cyclictest0-21swapper/221:16:142
28658991310,2cyclictest0-21swapper/219:35:162
2865899130,2cyclictest29243-21apt-get22:05:112
2865899130,2cyclictest0-21swapper/223:47:052
2865899130,2cyclictest0-21swapper/222:50:562
2865899130,2cyclictest0-21swapper/220:50:122
2865899130,2cyclictest0-21swapper/220:20:172
2865899130,2cyclictest0-21swapper/220:05:232
2865899130,12cyclictest0-21swapper/222:20:212
2865899130,12cyclictest0-21swapper/221:50:262
2865899130,12cyclictest0-21swapper/221:42:012
2865899130,11cyclictest12510-21diskmemload22:37:312
2865799138,3cyclictest26916-21cut23:15:151
2865799131,10cyclictest0-21swapper/100:15:201
28657991310,2cyclictest12510-21diskmemload23:05:181
28657991310,2cyclictest0-21swapper/123:33:021
28657991310,2cyclictest0-21swapper/122:51:331
28657991310,2cyclictest0-21swapper/122:37:531
2865799130,2cyclictest0-21swapper/123:28:491
2865799130,2cyclictest0-21swapper/121:44:411
2865799130,2cyclictest0-21swapper/121:30:171
2865799130,2cyclictest0-21swapper/121:11:381
2865799130,2cyclictest0-21swapper/119:45:181
2865799130,2cyclictest0-21swapper/119:10:221
2865799130,12cyclictest0-21swapper/100:25:251
2865799130,11cyclictest0-21swapper/122:25:211
28656991310,2cyclictest0-21swapper/023:56:000
28656991310,2cyclictest0-21swapper/023:20:350
28656991310,2cyclictest0-21swapper/021:40:230
28656991310,2cyclictest0-21swapper/021:37:010
28656991310,2cyclictest0-21swapper/021:19:170
28656991310,2cyclictest0-21swapper/020:45:130
28656991310,2cyclictest0-21swapper/000:12:250
2865699130,2cyclictest11738-21telnet23:35:120
2865699130,2cyclictest0-21swapper/023:00:100
2865699130,2cyclictest0-21swapper/021:51:540
2865699130,2cyclictest0-21swapper/000:25:120
2865699130,12cyclictest4492-21munin-node0
2865699130,12cyclictest25149-21ssh22:35:500
2865699130,12cyclictest0-21swapper/023:40:180
2865699130,12cyclictest0-21swapper/023:15:140
2865699130,12cyclictest0-21swapper/023:07:100
2865699130,12cyclictest0-21swapper/022:51:040
2865699130,12cyclictest0-21swapper/022:46:440
2865699130,12cyclictest0-21swapper/022:17:200
2865699130,12cyclictest0-21swapper/021:30:470
2865699130,12cyclictest0-21swapper/020:00:140
2865699130,12cyclictest0-21swapper/019:45:130
2865699130,12cyclictest0-21swapper/019:30:130
2865699130,12cyclictest0-21swapper/019:15:030
2865699130,12cyclictest0-21swapper/000:20:140
2865699130,11cyclictest0-21swapper/023:27:390
2865699130,11cyclictest0-21swapper/022:00:080
9712120,2sleep21208-21ssh00:00:002
2865999129,2cyclictest0-21swapper/321:40:313
2865999129,2cyclictest0-21swapper/320:40:163
2865999129,2cyclictest0-21swapper/319:30:143
2865999129,2cyclictest0-21swapper/300:35:303
2865999120,2cyclictest0-21swapper/320:30:173
2865999120,2cyclictest0-21swapper/320:20:233
2865999120,2cyclictest0-21swapper/319:45:173
2865999120,11cyclictest0-21swapper/323:05:003
2865999120,11cyclictest0-21swapper/321:49:113
2865999120,11cyclictest0-21swapper/321:49:103
2865999120,11cyclictest0-21swapper/321:35:483
2865999120,11cyclictest0-21swapper/319:55:243
2865899129,2cyclictest548-21kworker/u8:219:40:052
2865899129,2cyclictest26946-21kworker/u8:020:27:042
2865899129,2cyclictest16530-21kworker/u8:220:12:052
2865899129,2cyclictest0-21swapper/223:50:212
2865899129,2cyclictest0-21swapper/223:25:092
2865899129,2cyclictest0-21swapper/222:32:502
2865899129,2cyclictest0-21swapper/222:10:142
2865899129,2cyclictest0-21swapper/200:10:132
2865899121,10cyclictest8121-21ssh22:17:012
2865899120,2cyclictest0-21swapper/221:05:142
2865899120,2cyclictest0-21swapper/220:30:172
2865899120,2cyclictest0-21swapper/220:15:152
2865899120,11cyclictest0-21swapper/223:31:122
2865899120,11cyclictest0-21swapper/223:19:012
2865899120,11cyclictest0-21swapper/221:29:262
2865899120,11cyclictest0-21swapper/219:45:182
2865899120,10cyclictest12510-21diskmemload23:24:082
2865799129,2cyclictest0-21swapper/123:55:421
2865799129,2cyclictest0-21swapper/123:21:531
2865799129,2cyclictest0-21swapper/122:56:331
2865799129,2cyclictest0-21swapper/120:20:151
2865799129,2cyclictest0-21swapper/119:25:251
2865799129,2cyclictest0-21swapper/100:24:221
2865799128,2cyclictest0-21swapper/120:45:181
2865799127,3cyclictest0-21swapper/122:40:121
2865799122,7cyclictest0-21swapper/119:34:591
2865799122,6cyclictest0-21swapper/120:56:591
2865799121,9cyclictest10090-21apt-get22:20:111
2865799121,3cyclictest12510-21diskmemload22:45:251
2865799120,2cyclictest0-21swapper/122:02:121
2865799120,2cyclictest0-21swapper/119:35:121
2865799120,2cyclictest0-21swapper/100:35:201
2865799120,11cyclictest0-21swapper/123:37:401
2865799120,11cyclictest0-21swapper/122:15:531
2865799120,11cyclictest0-21swapper/122:07:381
2865799120,11cyclictest0-21swapper/121:20:131
2865799120,11cyclictest0-21swapper/121:15:181
2865799120,11cyclictest0-21swapper/121:05:171
2865799120,11cyclictest0-21swapper/120:35:251
2865799120,11cyclictest0-21swapper/120:10:171
2865799120,11cyclictest0-21swapper/100:10:181
2865799120,10cyclictest12510-21diskmemload21:45:231
2865799120,10cyclictest12510-21diskmemload21:45:231
2865699129,2cyclictest0-21swapper/021:00:170
2865699120,2cyclictest0-21swapper/023:50:150
2865699120,2cyclictest0-21swapper/019:40:260
2865699120,2cyclictest0-21swapper/019:20:130
2865999118,2cyclictest0-21swapper/323:44:173
2865999111,7cyclictest0-21swapper/320:49:593
2865899118,2cyclictest2640-21kworker/u8:120:47:042
2865899118,2cyclictest0-21swapper/219:15:222
2865899110,10cyclictest12510-21diskmemload23:12:412
2865799118,2cyclictest0-21swapper/119:40:151
2865799116,3cyclictest25193-21grep23:50:111
2865799112,6cyclictest0-21swapper/119:55:141
2865799111,3cyclictest30334-21date21:30:001
2865799111,3cyclictest19719-21grep20:05:171
2865799110,9cyclictest0-21swapper/120:15:151
2865799110,10cyclictest12510-21diskmemload00:33:511
2865699118,2cyclictest0-21swapper/020:58:450
2865699118,2cyclictest0-21swapper/020:30:120
2865699118,2cyclictest0-21swapper/020:15:130
2865999107,2cyclictest0-21swapper/319:25:243
2865999105,3cyclictest8485-21munin-run21:00:003
2865999105,3cyclictest29410-21fschecks_time19:10:133
2865999105,3cyclictest23865-21pzem_voltage20:15:223
2865999105,3cyclictest21390-21grep20:10:133
2865999105,3cyclictest18699-21cat20:04:593
2865999100,7cyclictest0-21swapper/319:24:593
2865899107,2cyclictest26946-21kworker/u8:021:02:052
2865899107,2cyclictest26946-21kworker/u8:020:38:052
2865899107,2cyclictest0-21swapper/220:00:212
2865899105,4cyclictest277-21jbd2/sda1-819:55:052
2865899100,2cyclictest0-21swapper/200:31:442
2865799107,2cyclictest0-21swapper/119:15:151
2865799100,8cyclictest0-21swapper/120:50:121
2865799100,3cyclictest8709-21munin-node1
2865699107,2cyclictest0-21swapper/020:35:140
2865699105,3cyclictest28156-21sed20:25:240
2865699100,8cyclictest7458-21runrttasks20:05:360
286599994,3cyclictest19883-21mailstats20:05:223
286599994,3cyclictest11412-21kernelversion21:05:163
286599994,3cyclictest0-21swapper/319:45:003
286599991,7cyclictest0-21swapper/320:27:023
286589994,3cyclictest5404-21ntp_kernel_err19:30:152
286579996,2cyclictest0-21swapper/120:40:111
286569996,2cyclictest26946-21kworker/u8:020:41:050
286569996,2cyclictest0-21swapper/021:05:110
286569996,2cyclictest0-21swapper/019:35:240
286599980,7cyclictest0-21swapper/321:00:093
286589983,3cyclictest611-21basename20:40:122
286569985,2cyclictest0-21swapper/020:22:260
286569985,2cyclictest0-21swapper/019:29:270
286569981,5cyclictest21099-21tr20:10:120
286569980,7cyclictest0-21swapper/019:55:190
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional