You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-03 - 05:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Sat Jan 03, 2026 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4782211998,16sleep10-21swapper/119:05:481
4818211794,18sleep00-21swapper/019:06:150
4989211697,13sleep20-21swapper/219:08:292
4804211394,14sleep30-21swapper/319:06:063
1041021080,1sleep00-21swapper/019:20:200
167002920,0sleep20-21swapper/219:35:232
163182810,0sleep30-21swapper/323:33:103
185372320,0sleep00-21swapper/000:13:040
35602250,0sleep20-21swapper/223:55:222
309972240,1sleep00-21swapper/022:35:150
513799210,4cyclictest328750irq/24-eth121:48:051
125792200,0sleep20-21swapper/220:45:182
5137991916,2cyclictest17244-21kworker/u8:019:59:051
5137991915,3cyclictest1328-21kworker/u8:020:27:041
513799191,2cyclictest0-21swapper/122:19:041
5139991815,2cyclictest29462-21kworker/u8:022:55:053
5139991815,2cyclictest15328-21kworker/u8:221:48:043
513899180,2cyclictest0-21swapper/222:30:052
5137991815,2cyclictest5093-21kworker/u8:119:49:041
4622180,0sleep30-21swapper/322:37:063
5139991714,2cyclictest29462-21kworker/u8:022:50:043
513999170,2cyclictest0-21swapper/322:30:053
5138991714,2cyclictest15328-21kworker/u8:222:04:042
5138991714,2cyclictest11622-21kworker/u8:221:17:052
513899171,14cyclictest570-21ssh22:37:172
5137991714,2cyclictest9507-21kworker/u8:021:35:041
5137991714,2cyclictest5431-21kworker/u8:120:43:051
5137991714,2cyclictest31132-21kworker/u8:200:33:031
5137991714,2cyclictest2429-21kworker/u8:122:42:041
5137991714,2cyclictest23848-21kworker/u8:021:54:041
5137991714,2cyclictest21708-21kworker/u8:220:18:051
5137991714,2cyclictest17244-21kworker/u8:020:03:041
5137991714,2cyclictest17244-21kworker/u8:019:41:051
5137991714,2cyclictest17221-21kworker/u8:120:58:051
5137991714,2cyclictest1328-21kworker/u8:020:54:041
5137991714,2cyclictest1328-21kworker/u8:020:22:051
5137991714,2cyclictest12891-21kworker/u8:023:34:041
5137991714,2cyclictest11622-21kworker/u8:221:08:051
5137991714,2cyclictest11622-21kworker/u8:220:48:041
5137991713,3cyclictest25311-21kworker/u8:321:29:041
513799171,2cyclictest0-21swapper/100:22:051
5138991613,2cyclictest19211-21kworker/u8:122:27:042
513899161,13cyclictest27713-21apt-get20:05:122
513899161,13cyclictest0-21swapper/223:26:442
513799162,3cyclictest100742chrt22:48:311
513799161,3cyclictest24836-21iostat_ios23:05:161
5137991613,2cyclictest7702-21kworker/u8:019:22:041
5137991613,2cyclictest5093-21kworker/u8:119:27:041
5137991613,2cyclictest5093-21kworker/u8:119:10:041
5137991613,2cyclictest4865-21kworker/u8:200:17:031
5137991613,2cyclictest4865-21kworker/u8:200:04:051
5137991613,2cyclictest3407-21kworker/u8:023:23:051
5137991613,2cyclictest25311-21kworker/u8:321:22:051
5137991613,2cyclictest19103-21kworker/u8:123:14:051
5137991613,2cyclictest17221-21kworker/u8:121:00:041
5137991613,2cyclictest13407-21kworker/u8:222:25:041
513799160,2cyclictest0-21swapper/121:57:051
513799160,2cyclictest0-21swapper/121:41:051
513699160,14cyclictest0-21swapper/023:00:140
5139991512,2cyclictest7533-21kworker/u8:022:19:053
513999151,12cyclictest20738-21memory00:15:173
513899151,3cyclictest17244-21ssh22:55:472
5138991512,2cyclictest0-21swapper/223:47:282
513899151,12cyclictest14034-21ssh22:52:482
513899151,12cyclictest0-21swapper/222:10:432
513899151,12cyclictest0-21swapper/200:36:242
513899150,13cyclictest0-21swapper/221:39:272
513899150,13cyclictest0-21swapper/221:00:182
513799151,2cyclictest21427-21diskmemload00:26:051
5137991512,2cyclictest5093-21kworker/u8:119:15:041
5137991512,2cyclictest4865-21kworker/u8:223:59:041
5137991512,2cyclictest31132-21kworker/u8:200:38:051
5137991512,2cyclictest27748-21kworker/u8:120:06:051
513799150,2cyclictest0-21swapper/123:03:031
513799150,2cyclictest0-21swapper/122:38:051
513799150,2cyclictest0-21swapper/122:05:041
513799150,2cyclictest0-21swapper/122:00:041
513799150,2cyclictest0-21swapper/121:15:041
513699151,12cyclictest26318-21apt-get23:45:120
513699150,13cyclictest0-21swapper/022:26:330
117442150,0sleep00-21swapper/000:05:130
513999141,2cyclictest21793-21aten2.4-expect21:10:113
5139991411,2cyclictest19103-21kworker/u8:123:11:043
5139991411,2cyclictest0-21swapper/323:51:123
5139991411,2cyclictest0-21swapper/322:10:113
5139991411,2cyclictest0-21swapper/320:55:113
513999140,13cyclictest0-21swapper/300:05:033
513999140,12cyclictest0-21swapper/323:55:103
513999140,12cyclictest0-21swapper/321:24:193
513999140,12cyclictest0-21swapper/320:30:153
513999140,12cyclictest0-21swapper/300:25:093
5138991411,2cyclictest9507-21kworker/u8:021:34:052
5138991411,2cyclictest4637-21ssh22:41:482
5138991411,2cyclictest23107-21ssh23:03:402
5138991411,2cyclictest11414-21kworker/u8:100:09:042
5138991411,2cyclictest0-21swapper/200:21:582
513899140,3cyclictest0-21swapper/223:38:162
513899140,3cyclictest0-21swapper/221:49:442
513899140,2cyclictest0-21swapper/223:31:182
513899140,13cyclictest0-21swapper/222:45:212
513899140,12cyclictest27130-21vmstat20:00:262
513899140,12cyclictest21427-21diskmemload21:52:572
513899140,12cyclictest0-21swapper/223:42:572
513899140,12cyclictest0-21swapper/223:16:592
513899140,12cyclictest0-21swapper/223:14:122
513899140,12cyclictest0-21swapper/223:06:052
513899140,12cyclictest0-21swapper/200:11:022
513899140,12cyclictest0-21swapper/200:00:142
513799149,3cyclictest0-21swapper/123:36:251
5137991410,2cyclictest0-21swapper/121:10:161
513799140,2cyclictest28741-21sh23:47:051
513799140,2cyclictest0-21swapper/123:54:331
513799140,2cyclictest0-21swapper/122:55:341
513799140,2cyclictest0-21swapper/100:10:051
513799140,13cyclictest0-21swapper/122:51:131
513799140,13cyclictest0-21swapper/121:32:341
513799140,13cyclictest0-21swapper/100:08:041
513799140,12cyclictest26211-21apt-get22:30:111
5136991411,2cyclictest21427-21diskmemload23:23:340
513699141,12cyclictest21427-21diskmemload22:57:130
5136991411,2cyclictest0-21swapper/021:50:130
5136991410,2cyclictest2604-21ssh23:55:110
513699140,2cyclictest21427-21diskmemload22:10:040
513699140,12cyclictest8880-21awk20:35:260
513699140,12cyclictest6675-21snmpd23:31:560
513699140,12cyclictest21723-21munin-node0
513699140,12cyclictest0-21swapper/021:55:330
513699140,12cyclictest0-21swapper/021:23:130
513699140,12cyclictest0-21swapper/000:15:190
513699140,12cyclictest0-21swapper/000:03:330
73272130,2sleep021427-21diskmemload21:30:190
5139991310,2cyclictest25557-21ssh21:50:443
5139991310,2cyclictest24337-21kworker/u8:000:22:053
5139991310,2cyclictest0-21swapper/323:15:163
5139991310,2cyclictest0-21swapper/322:45:153
5139991310,2cyclictest0-21swapper/321:42:503
5139991310,2cyclictest0-21swapper/321:37:513
5139991310,2cyclictest0-21swapper/319:55:123
5139991310,2cyclictest0-21swapper/319:20:213
5139991310,2cyclictest0-21swapper/300:35:173
513999130,2cyclictest0-21swapper/323:00:193
513999130,2cyclictest0-21swapper/322:25:013
513999130,2cyclictest0-21swapper/322:20:193
513999130,2cyclictest0-21swapper/319:35:183
513999130,12cyclictest4865-21kworker/u8:200:02:043
513999130,12cyclictest0-21swapper/323:46:193
513999130,12cyclictest0-21swapper/323:36:003
513999130,12cyclictest0-21swapper/323:22:103
513999130,12cyclictest0-21swapper/322:00:593
513999130,12cyclictest0-21swapper/321:27:403
513999130,12cyclictest0-21swapper/300:33:593
513999130,11cyclictest11414-21kworker/u8:100:11:053
513999130,11cyclictest0-21swapper/321:55:523
5138991310,2cyclictest0-21swapper/221:25:002
5138991310,2cyclictest0-21swapper/221:20:322
5138991310,2cyclictest0-21swapper/221:10:562
5138991310,2cyclictest0-21swapper/200:27:552
5138991310,2cyclictest0-21swapper/200:18:312
513899130,2cyclictest0-21swapper/220:25:282
513899130,12cyclictest0-21swapper/223:50:472
513899130,12cyclictest0-21swapper/222:20:552
513899130,12cyclictest0-21swapper/222:06:262
513899130,12cyclictest0-21swapper/221:55:582
513899130,12cyclictest0-21swapper/220:40:242
513799138,3cyclictest0-21swapper/119:35:181
5137991310,2cyclictest5093-21kworker/u8:119:31:041
5137991310,2cyclictest0-21swapper/123:26:141
5137991310,2cyclictest0-21swapper/120:30:171
513799130,2cyclictest0-21swapper/122:10:051
513799130,2cyclictest0-21swapper/119:53:051
513799130,12cyclictest21427-21diskmemload22:21:471
513799130,12cyclictest0-21swapper/123:15:141
513799130,12cyclictest0-21swapper/120:39:041
513699139,2cyclictest17524-21ssh22:20:030
5136991310,2cyclictest29462-21kworker/u8:022:51:040
5136991310,2cyclictest21427-21diskmemload00:36:180
5136991310,2cyclictest0-21swapper/021:43:150
5136991310,2cyclictest0-21swapper/021:25:150
5136991310,2cyclictest0-21swapper/000:30:310
513699130,3cyclictest2486-21ssh23:16:480
513699130,2cyclictest21427-21diskmemload23:25:120
513699130,2cyclictest0-21swapper/022:42:230
513699130,2cyclictest0-21swapper/019:35:170
513699130,12cyclictest0-21swapper/023:50:130
513699130,12cyclictest0-21swapper/022:30:160
513699130,12cyclictest0-21swapper/022:09:020
513699130,12cyclictest0-21swapper/022:04:280
513699130,11cyclictest21427-21diskmemload21:45:360
162662130,2sleep20-21swapper/222:18:102
513999129,2cyclictest11622-21kworker/u8:221:15:053
513999129,2cyclictest0-21swapper/320:10:213
513999129,2cyclictest0-21swapper/320:05:223
513999129,2cyclictest0-21swapper/319:29:393
5139991210,1cyclictest0-21swapper/321:05:213
513999120,2cyclictest0-21swapper/323:41:053
513999120,2cyclictest0-21swapper/320:35:183
513999120,11cyclictest0-21swapper/323:26:393
513999120,11cyclictest0-21swapper/323:05:303
513999120,11cyclictest0-21swapper/322:41:363
513999120,11cyclictest0-21swapper/322:07:393
513999120,11cyclictest0-21swapper/321:30:203
513999120,11cyclictest0-21swapper/320:00:133
513899129,2cyclictest0-21swapper/223:20:542
513899129,2cyclictest0-21swapper/221:41:162
513899129,2cyclictest0-21swapper/220:30:142
513899129,2cyclictest0-21swapper/219:45:272
513899120,11cyclictest0-21swapper/219:40:182
513899120,11cyclictest0-21swapper/219:10:182
513899120,11cyclictest0-21swapper/200:30:242
513799129,2cyclictest0-21swapper/123:40:141
513799121,9cyclictest29722-21munin-node1
513699129,2cyclictest0-21swapper/023:38:330
513699129,2cyclictest0-21swapper/023:05:520
513699129,2cyclictest0-21swapper/020:25:130
513699129,2cyclictest0-21swapper/019:29:590
513699129,2cyclictest0-21swapper/000:25:370
513699129,2cyclictest0-21swapper/000:22:420
513699120,2cyclictest0-21swapper/022:45:200
513699120,11cyclictest21427-21diskmemload23:10:380
513699120,11cyclictest0-21swapper/023:40:340
513699120,11cyclictest0-21swapper/022:16:520
513699120,11cyclictest0-21swapper/021:35:200
513699120,11cyclictest0-21swapper/021:16:420
513699120,11cyclictest0-21swapper/020:10:140
513699120,11cyclictest0-21swapper/020:05:130
513999118,2cyclictest5093-21kworker/u8:119:33:033
513999118,2cyclictest0-21swapper/321:00:143
513999118,2cyclictest0-21swapper/319:10:143
513999110,10cyclictest0-21swapper/319:15:223
513899114,5cyclictest277-21jbd2/sda1-819:50:042
513899113,6cyclictest277-21jbd2/sda1-819:25:062
513899110,1cyclictest0-21swapper/220:35:182
513899110,1cyclictest0-21swapper/219:55:232
513699110,9cyclictest277-21jbd2/sda1-820:30:240
513699110,10cyclictest5431-21kworker/u8:120:42:050
146122110,1sleep00-21swapper/020:50:220
513999107,2cyclictest21708-21kworker/u8:219:53:053
513999107,2cyclictest0-21swapper/320:20:243
513999106,3cyclictest32159-21diskstats20:15:173
513999100,2cyclictest0-21swapper/320:50:153
513699107,2cyclictest0-21swapper/020:15:210
51399996,2cyclictest5431-21kworker/u8:120:45:043
51399990,2cyclictest0-21swapper/319:47:583
51389996,2cyclictest14714-21swap20:50:262
51389996,2cyclictest0-21swapper/219:20:222
51389994,3cyclictest8029-21fschecks_time19:15:152
51389994,3cyclictest7458-21runrttasks20:56:002
51389994,3cyclictest20208-21grep21:05:182
51389991,6cyclictest32295-21sort20:15:182
51389991,3cyclictest0-21swapper/220:20:172
51369996,2cyclictest15602-21apt-get20:55:120
51369996,2cyclictest0-21swapper/020:45:200
51369996,2cyclictest0-21swapper/019:30:150
51369994,3cyclictest6593-21threads19:10:260
51369994,3cyclictest25906-21cpu20:00:130
51369994,3cyclictest24615-21proc_pri19:55:190
51369994,3cyclictest20439-21cat21:05:200
51369990,2cyclictest0-21swapper/019:40:150
9564280,1sleep30-21swapper/320:40:053
51399982,3cyclictest0-21swapper/319:40:133
51399980,7cyclictest0-21swapper/320:25:233
51389985,2cyclictest5093-21kworker/u8:119:30:052
51389983,3cyclictest29984-21cut20:10:142
51369985,2cyclictest7702-21kworker/u8:019:15:220
51369984,3cyclictest6867-21nscd19:50:000
51369984,3cyclictest17708-21aten2.4_r3power21:00:130
51369984,2cyclictest22198-21fschecks_time19:50:160
51369972,3cyclictest1873-21fschecks_time20:20:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional