You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-21 - 21:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Sun Dec 21, 2025 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22937212094,19sleep00-21swapper/007:05:180
23990211694,16sleep30-21swapper/307:09:223
23945211395,12sleep20-21swapper/207:08:492
23723211396,12sleep10-21swapper/107:05:551
209812860,0sleep00-21swapper/011:50:150
180832780,1sleep10-21swapper/112:23:511
143312730,1sleep00-21swapper/009:52:500
285302290,0sleep00-21swapper/009:32:140
261222270,1sleep00-21swapper/011:20:010
241102230,0sleep00-21swapper/009:27:130
253312220,1sleep20-21swapper/210:05:192
24068992218,2cyclictest0-21swapper/211:20:122
2406899212,14cyclictest0-21swapper/210:51:052
2406899212,14cyclictest0-21swapper/210:51:052
24066992117,2cyclictest0-21swapper/010:40:130
229142210,1sleep10-21swapper/112:29:401
318172200,0sleep30-21swapper/310:12:533
2406899200,18cyclictest0-21swapper/212:30:122
2406899190,14cyclictest0-21swapper/209:45:052
24067991815,2cyclictest8785-21kworker/u8:011:03:041
24067991815,2cyclictest20144-21kworker/u8:010:20:051
2406999171,3cyclictest0-21swapper/308:50:113
2406899171,14cyclictest20564-21aten2.4_r3power08:20:132
2406899170,12cyclictest0-21swapper/212:10:052
2406899170,12cyclictest0-21swapper/211:39:042
24067991714,2cyclictest6165-21kworker/u8:209:30:051
24067991714,2cyclictest32593-21kworker/u8:009:18:051
24067991714,2cyclictest2781-21kworker/u8:111:31:051
24067991714,2cyclictest11770-21kworker/u8:011:49:041
2406799171,2cyclictest328750irq/24-eth109:39:041
2406799170,12cyclictest0-21swapper/112:13:051
2406799170,12cyclictest0-21swapper/111:09:041
2406799170,12cyclictest0-21swapper/109:27:041
24069991611,3cyclictest8122-21diskmemload11:52:523
2406999161,13cyclictest22106-21aten2.4-expect11:15:123
24068991613,2cyclictest30472-21kworker/u8:009:41:042
24068991613,2cyclictest22549-21kworker/u8:012:38:052
24068991611,3cyclictest0-21swapper/211:49:272
2406899160,2cyclictest0-21swapper/212:15:052
2406899160,2cyclictest0-21swapper/209:39:042
2406899160,11cyclictest0-21swapper/210:32:052
24067991613,2cyclictest26363-21kworker/u8:110:25:051
24067991613,2cyclictest20144-21kworker/u8:010:03:051
2406799161,2cyclictest0-21swapper/112:15:051
2406699160,14cyclictest0-21swapper/011:33:580
24069991512,2cyclictest0-21swapper/312:20:223
24069991512,2cyclictest0-21swapper/311:10:223
2406999150,2cyclictest0-21swapper/311:01:323
2406999150,13cyclictest27682-21ssh12:35:023
2406999150,13cyclictest0-21swapper/308:55:123
2406899152,7cyclictest0-21swapper/209:20:002
24068991512,2cyclictest0-21swapper/212:08:042
2406899150,13cyclictest0-21swapper/210:04:052
24067991512,2cyclictest5983-21kworker/u8:109:59:051
24067991512,2cyclictest29238-21kworker/u8:012:05:041
24067991512,2cyclictest26363-21kworker/u8:110:06:051
24067991512,2cyclictest2618-21kworker/u8:311:40:051
24067991512,2cyclictest22549-21kworker/u8:012:36:051
24067991512,2cyclictest11770-21kworker/u8:011:53:051
2406799151,12cyclictest28086-21apt-get07:20:051
2406799150,3cyclictest26576-21cut11:20:131
2406799150,13cyclictest8122-21diskmemload10:59:361
2406799150,13cyclictest19485-21sed10:35:151
24066991512,2cyclictest0-21swapper/011:58:580
2406699150,13cyclictest0-21swapper/010:15:390
2406999142,7cyclictest0-21swapper/311:30:013
24069991411,2cyclictest28160-21ssh11:20:523
24069991411,2cyclictest0-21swapper/310:59:523
24069991411,2cyclictest0-21swapper/310:40:423
24069991411,2cyclictest0-21swapper/310:02:123
24069991411,2cyclictest0-21swapper/309:58:523
24069991411,2cyclictest0-21swapper/309:40:323
2406999140,3cyclictest27468-21munin-run12:35:003
2406999140,2cyclictest0-21swapper/311:39:223
2406999140,13cyclictest0-21swapper/312:04:423
2406999140,12cyclictest8122-21diskmemload12:09:333
2406999140,12cyclictest0-21swapper/309:35:003
2406899149,3cyclictest21026-21hddtemp_smartct11:50:152
2406899142,7cyclictest0-21swapper/208:35:012
2406899142,6cyclictest0-21swapper/211:30:012
2406899142,6cyclictest0-21swapper/209:05:012
2406899142,6cyclictest0-21swapper/208:55:012
2406899142,6cyclictest0-21swapper/208:50:012
24068991411,2cyclictest5983-21kworker/u8:109:51:052
24068991411,2cyclictest24270-21kworker/u8:207:20:052
24068991411,2cyclictest0-21swapper/210:14:032
2406899140,3cyclictest31355-21ssh10:49:172
2406899140,2cyclictest0-21swapper/212:29:152
2406899140,2cyclictest0-21swapper/211:55:052
2406899140,12cyclictest0-21swapper/212:20:152
2406899140,12cyclictest0-21swapper/211:33:382
2406899140,12cyclictest0-21swapper/211:10:272
2406899140,12cyclictest0-21swapper/210:15:582
2406899140,12cyclictest0-21swapper/209:56:472
2406899140,12cyclictest0-21swapper/209:34:352
2406899140,12cyclictest0-21swapper/209:13:072
2406799143,9cyclictest6226-21gdm311:55:041
24067991411,2cyclictest6165-21kworker/u8:209:47:041
24067991411,2cyclictest5983-21kworker/u8:109:52:051
24067991411,2cyclictest32593-21kworker/u8:008:57:051
24067991411,2cyclictest30354-21kworker/u8:108:01:051
24067991411,2cyclictest2618-21kworker/u8:311:37:041
24067991411,2cyclictest2618-21kworker/u8:310:53:041
24067991411,2cyclictest2618-21kworker/u8:310:53:041
24067991411,2cyclictest21841-21kworker/u8:010:42:051
24067991411,2cyclictest14599-21kworker/u8:208:16:051
24067991410,2cyclictest6165-21kworker/u8:209:23:051
24067991410,2cyclictest20793-21df08:20:141
2406799140,2cyclictest0-21swapper/110:31:041
2406799140,13cyclictest0-21swapper/110:10:061
2406799140,13cyclictest0-21swapper/107:50:151
2406799140,12cyclictest0-21swapper/111:13:201
2406799140,12cyclictest0-21swapper/107:45:181
2406699149,3cyclictest31229-21ssh10:11:510
24066991411,2cyclictest0-21swapper/011:40:580
24066991411,2cyclictest0-21swapper/011:21:590
24066991411,2cyclictest0-21swapper/010:53:390
24066991411,2cyclictest0-21swapper/010:53:390
24066991410,2cyclictest20481-21ssh09:23:460
2406699140,13cyclictest0-21swapper/012:38:550
2406699140,13cyclictest0-21swapper/012:33:590
2406699140,13cyclictest0-21swapper/010:05:090
2406699140,13cyclictest0-21swapper/009:55:100
2406699140,12cyclictest8122-21diskmemload12:15:140
2406699140,12cyclictest8122-21diskmemload10:56:420
2406699140,12cyclictest8122-21diskmemload09:36:450
2406699140,12cyclictest14710-21diskmemload09:16:130
2406699140,12cyclictest0-21swapper/012:21:060
2406699140,12cyclictest0-21swapper/011:46:390
2406699140,12cyclictest0-21swapper/010:20:170
2406699140,12cyclictest0-21swapper/009:10:580
207692140,2sleep00-21swapper/012:25:470
116812140,2sleep00-21swapper/010:25:540
29672130,2sleep00-21swapper/012:05:550
2406999138,3cyclictest5983-21kworker/u8:109:47:503
2406999132,6cyclictest0-21swapper/308:05:003
24069991310,2cyclictest0-21swapper/312:12:423
24069991310,2cyclictest0-21swapper/311:40:233
24069991310,2cyclictest0-21swapper/309:39:423
24069991310,2cyclictest0-21swapper/309:15:283
2406999130,2cyclictest0-21swapper/310:52:333
2406999130,2cyclictest0-21swapper/310:52:323
2406999130,2cyclictest0-21swapper/310:28:033
2406999130,2cyclictest0-21swapper/310:20:423
2406999130,12cyclictest0-21swapper/311:46:433
2406999130,11cyclictest0-21swapper/310:15:263
2406999130,11cyclictest0-21swapper/309:26:173
2406999130,11cyclictest0-21swapper/309:20:113
2406899132,6cyclictest0-21swapper/208:15:002
2406899131,7cyclictest21535-21ssh09:25:112
24068991310,2cyclictest21841-21kworker/u8:010:41:052
24068991310,2cyclictest0-21swapper/211:07:182
24068991310,2cyclictest0-21swapper/211:00:142
24068991310,2cyclictest0-21swapper/210:57:052
2406899130,12cyclictest0-21swapper/212:00:192
2406899130,12cyclictest0-21swapper/210:26:132
2406899130,11cyclictest8122-21diskmemload10:20:542
2406799138,3cyclictest0-21swapper/108:05:121
24067991310,2cyclictest8122-21diskmemload11:26:061
24067991310,2cyclictest23967-21kworker/u8:109:03:041
24067991310,2cyclictest23967-21kworker/u8:108:45:051
24067991310,2cyclictest20178-21kworker/u8:011:17:051
24067991310,2cyclictest0-21swapper/112:31:501
24067991310,2cyclictest0-21swapper/109:10:521
2406799130,9cyclictest0-21swapper/108:36:051
2406799130,2cyclictest0-21swapper/110:16:441
2406799130,12cyclictest0-21swapper/110:45:261
2406799130,12cyclictest0-21swapper/108:30:131
2406799130,12cyclictest0-21swapper/107:30:201
2406699133,6cyclictest0-21swapper/008:48:450
2406699133,6cyclictest0-21swapper/008:23:390
24066991310,2cyclictest0-21swapper/012:10:150
24066991310,2cyclictest0-21swapper/012:00:560
24066991310,2cyclictest0-21swapper/011:36:160
24066991310,2cyclictest0-21swapper/011:01:120
24066991310,2cyclictest0-21swapper/009:40:340
24066991310,2cyclictest0-21swapper/008:15:130
24066991310,2cyclictest0-21swapper/008:00:140
2406699130,2cyclictest8122-21diskmemload11:08:060
2406699130,2cyclictest8122-21diskmemload09:48:210
2406699130,2cyclictest0-21swapper/011:25:390
2406699130,2cyclictest0-21swapper/011:10:390
2406699130,2cyclictest0-21swapper/010:45:060
2406699130,12cyclictest0-21swapper/010:01:290
2406999129,2cyclictest0-21swapper/311:05:173
2406999129,2cyclictest0-21swapper/309:53:523
2406999127,3cyclictest19036-21df10:35:123
2406999122,7cyclictest0-21swapper/308:34:593
2406999120,2cyclictest0-21swapper/312:26:133
2406999120,2cyclictest0-21swapper/311:33:003
2406999120,2cyclictest0-21swapper/310:33:283
2406999120,11cyclictest0-21swapper/310:07:033
2406999120,11cyclictest0-21swapper/309:00:263
2406999120,10cyclictest0-21swapper/311:57:053
2406999120,10cyclictest0-21swapper/310:45:043
2406999120,10cyclictest0-21swapper/309:10:313
2406899129,2cyclictest14599-21kworker/u8:208:09:052
2406899129,2cyclictest0-21swapper/210:35:482
2406899129,2cyclictest0-21swapper/209:20:342
2406899129,2cyclictest0-21swapper/208:40:172
2406899129,2cyclictest0-21swapper/207:55:162
2406899122,7cyclictest0-21swapper/207:27:592
2406899120,2cyclictest0-21swapper/211:15:582
2406899120,2cyclictest0-21swapper/209:05:172
2406899120,11cyclictest0-21swapper/211:42:172
2406899120,11cyclictest0-21swapper/207:35:002
2406799129,2cyclictest8122-21diskmemload12:00:351
2406799129,2cyclictest6165-21kworker/u8:209:06:051
2406799129,2cyclictest0-21swapper/107:10:171
2406799122,8cyclictest21-21rcuc/107:35:171
2406799122,7cyclictest0-21swapper/107:56:591
2406799121,3cyclictest32555-21munin-node1
2406799120,2cyclictest0-21swapper/109:40:451
2406799120,11cyclictest0-21swapper/108:25:211
2406699129,2cyclictest0-21swapper/010:30:110
2406699129,2cyclictest0-21swapper/008:55:210
2406699129,2cyclictest0-21swapper/007:10:180
2406699122,5cyclictest0-21swapper/007:55:000
2406699120,2cyclictest0-21swapper/008:50:140
2406699120,11cyclictest0-21swapper/010:36:050
2406699120,11cyclictest0-21swapper/008:05:200
2406699120,11cyclictest0-21swapper/007:40:160
2406699120,11cyclictest0-21swapper/007:35:240
2406999118,2cyclictest0-21swapper/312:16:423
2406999118,2cyclictest0-21swapper/307:35:263
2406999112,7cyclictest0-21swapper/307:48:023
2406999111,7cyclictest0-21swapper/308:13:593
2406999111,7cyclictest0-21swapper/308:13:593
2406999111,6cyclictest0-21swapper/307:50:123
2406999110,2cyclictest0-21swapper/307:10:253
2406999110,10cyclictest0-21swapper/307:20:173
2406899118,2cyclictest32593-21kworker/u8:008:55:052
2406899118,2cyclictest30354-21kworker/u8:108:03:052
2406899118,2cyclictest0-21swapper/207:35:152
2406899118,2cyclictest0-21swapper/207:10:282
2406899110,10cyclictest0-21swapper/207:45:262
2406799117,2cyclictest0-21swapper/107:25:171
2406799111,8cyclictest0-21swapper/107:40:141
2406799110,9cyclictest16441-21munin-node1
2406799110,9cyclictest16441-21munin-node1
2406699118,2cyclictest0-21swapper/007:25:150
2406699113,6cyclictest0-21swapper/008:13:370
2406699113,6cyclictest0-21swapper/008:13:360
2406699111,5cyclictest0-21swapper/007:45:000
2406699110,10cyclictest0-21swapper/007:20:100
2406999107,2cyclictest0-21swapper/308:35:143
2406999107,2cyclictest0-21swapper/308:05:153
2406999102,6cyclictest0-21swapper/307:45:003
2406999102,6cyclictest0-21swapper/307:25:253
2406999102,6cyclictest0-21swapper/307:15:223
2406899107,2cyclictest30354-21kworker/u8:107:52:052
2406899107,2cyclictest23967-21kworker/u8:108:29:042
2406899107,2cyclictest0-21swapper/208:35:142
2406899105,3cyclictest4930-21open_inodes07:40:182
2406899105,3cyclictest17070-21if_eth008:10:152
2406899105,3cyclictest17070-21if_eth008:10:152
2406799106,2cyclictest0-21swapper/107:15:211
2406699107,2cyclictest0-21swapper/008:33:080
2406699102,6cyclictest0-21swapper/009:05:260
2406699102,6cyclictest0-21swapper/007:33:290
2406699100,9cyclictest0-21swapper/008:38:090
2406699100,2cyclictest0-21swapper/007:55:240
240699996,2cyclictest0-21swapper/307:30:133
240699994,3cyclictest30331-21latency_hist08:45:013
240699994,3cyclictest23275-21missed_timers08:25:153
240699994,3cyclictest21247-21latency08:20:173
240699994,3cyclictest12193-21latency_hist08:00:003
240699990,6cyclictest0-21swapper/308:16:593
240689996,2cyclictest24270-21kworker/u8:207:18:052
240679994,3cyclictest29804-21ls08:40:251
240669994,3cyclictest4250-21aten2.4_r3power09:00:130
240669993,4cyclictest0-21swapper/008:40:240
240669990,2cyclictest0-21swapper/008:29:190
240699983,3cyclictest31147-21hwlatdetect08:45:163
240699983,2cyclictest6347-21telnet09:05:163
240669983,3cyclictest26523-21grep07:15:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional