You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-24 - 08:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Mon Nov 24, 2025 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8365211894,19sleep00-21swapper/019:08:240
6699211794,16sleep20-21swapper/219:05:092
8426211694,16sleep10-21swapper/119:09:131
8476210383,15sleep30-21swapper/319:09:513
188252740,1sleep00-21swapper/023:55:170
312462680,0sleep20-21swapper/223:00:112
8519993717,18cyclictest0-21swapper/223:45:102
100972230,0sleep10-21swapper/121:28:301
851999221,19cyclictest0-21swapper/221:00:132
289742220,1sleep10-21swapper/123:31:091
851999211,18cyclictest0-21swapper/221:45:122
320992210,1sleep10-21swapper/121:51:031
8520992017,2cyclictest10560-21kworker/u8:222:48:013
851699200,2cyclictest0-21swapper/019:35:110
8520991916,2cyclictest5494-21kworker/u8:022:33:053
8516991916,2cyclictest19740-21kworker/u8:200:01:040
8518991814,2cyclictest21-21rcuc/122:48:021
8516991815,2cyclictest771-21kworker/u8:123:20:020
8516991815,2cyclictest26548-21kworker/u8:223:07:050
8516991815,2cyclictest18970-21kworker/u8:122:36:050
851699180,16cyclictest0-21swapper/019:10:140
852099172,3cyclictest5119-21grep20:20:163
8516991714,2cyclictest771-21kworker/u8:123:15:040
8516991714,2cyclictest4004-21kworker/u8:100:08:050
8516991714,2cyclictest4004-21kworker/u8:100:08:040
8516991714,2cyclictest31230-21kworker/u8:200:38:050
8516991714,2cyclictest25782-21kworker/u8:123:32:060
8516991714,2cyclictest15241-21kworker/u8:223:50:040
851699171,2cyclictest0-21swapper/019:25:130
851699170,15cyclictest0-21swapper/023:10:390
852099161,3cyclictest25965-21python19:50:253
852099161,3cyclictest19873-21sensors00:30:243
8520991613,2cyclictest4004-21kworker/u8:123:53:053
8520991613,2cyclictest31877-21kworker/u8:121:55:053
8520991613,2cyclictest31877-21kworker/u8:121:55:043
8519991612,2cyclictest0-21swapper/200:15:162
851899161,13cyclictest15789-21ssh00:25:511
851899160,14cyclictest0-21swapper/122:14:111
851699161,3cyclictest32144-21grep23:35:140
8516991613,2cyclictest28525-21kworker/u8:220:29:050
8516991613,2cyclictest28525-21kworker/u8:220:14:050
8516991613,2cyclictest28525-21kworker/u8:220:08:050
8516991613,2cyclictest25643-21kworker/u8:021:57:050
8516991613,2cyclictest25643-21kworker/u8:021:57:040
8516991613,2cyclictest18774-21kworker/u8:221:49:050
8516991613,2cyclictest18259-21kworker/u8:021:03:050
8516991613,2cyclictest16828-21kworker/u8:119:54:040
851699160,11cyclictest0-21swapper/022:47:050
851699160,11cyclictest0-21swapper/022:10:040
270192160,1sleep30-21swapper/322:20:193
8520991512,2cyclictest25153-21kworker/u8:000:21:043
852099151,12cyclictest0-21swapper/321:40:153
8520991510,3cyclictest24636-21cat00:35:263
852099150,3cyclictest32222-21processes23:00:183
852099150,14cyclictest0-21swapper/322:42:093
852099150,14cyclictest0-21swapper/321:12:283
852099150,13cyclictest4753-21memory23:40:183
852099150,13cyclictest4541-21ssh21:22:163
852099150,13cyclictest0-21swapper/322:56:083
851999151,12cyclictest971-21seq23:35:482
851999150,13cyclictest0-21swapper/219:55:272
8518991512,2cyclictest0-21swapper/123:22:571
8518991512,2cyclictest0-21swapper/120:10:281
851899150,13cyclictest9190-21fschecks_count23:45:141
851899150,13cyclictest0-21swapper/122:17:161
851899150,13cyclictest0-21swapper/121:57:181
851899150,13cyclictest0-21swapper/121:57:181
8516991512,2cyclictest8709-21kworker/u8:120:49:050
8516991512,2cyclictest4556-21kworker/u8:020:31:050
8516991512,2cyclictest25643-21kworker/u8:021:53:050
8516991512,2cyclictest20850-21kworker/u8:221:22:060
8516991512,2cyclictest16828-21kworker/u8:119:55:050
8516991512,2cyclictest12809-21kworker/u8:019:21:050
851699150,10cyclictest0-21swapper/022:20:020
851699150,10cyclictest0-21swapper/020:37:050
8520991411,2cyclictest31230-21kworker/u8:200:25:053
8520991411,2cyclictest0-21swapper/322:11:383
8520991411,2cyclictest0-21swapper/322:05:393
8520991411,2cyclictest0-21swapper/321:50:523
852099140,2cyclictest0-21swapper/322:52:553
852099140,13cyclictest0-21swapper/322:37:283
852099140,13cyclictest0-21swapper/321:17:113
852099140,12cyclictest24660-21diskmemload23:29:473
852099140,12cyclictest0-21swapper/323:45:103
852099140,12cyclictest0-21swapper/321:37:523
851999149,3cyclictest0-21swapper/222:21:152
851999149,3cyclictest0-21swapper/220:15:042
851999142,10cyclictest0-21swapper/223:34:532
8519991411,2cyclictest24660-21diskmemload23:05:462
8519991411,2cyclictest0-21swapper/223:16:262
8519991411,2cyclictest0-21swapper/222:52:062
8519991411,2cyclictest0-21swapper/222:31:562
8519991411,2cyclictest0-21swapper/222:25:062
851999140,3cyclictest18019-21sh21:36:082
851999140,2cyclictest0-21swapper/223:25:252
851999140,1cyclictest0-21swapper/200:29:462
851999140,12cyclictest26568-21kworker/u8:100:38:532
851999140,12cyclictest24660-21diskmemload22:46:162
851999140,12cyclictest24660-21diskmemload21:52:442
851999140,12cyclictest0-21swapper/200:06:092
851999140,12cyclictest0-21swapper/200:06:082
8518991411,2cyclictest0-21swapper/123:41:471
8518991411,2cyclictest0-21swapper/123:35:171
8518991410,2cyclictest24660-21diskmemload22:56:241
851899140,2cyclictest0-21swapper/121:36:581
851899140,2cyclictest0-21swapper/121:20:241
851899140,1cyclictest0-21swapper/122:31:381
851899140,13cyclictest0-21swapper/123:08:371
851899140,13cyclictest0-21swapper/121:49:481
851899140,13cyclictest0-21swapper/120:50:171
851899140,13cyclictest0-21swapper/120:40:171
851899140,12cyclictest24660-21diskmemload23:00:141
851899140,12cyclictest24660-21diskmemload21:40:341
851899140,12cyclictest0-21swapper/123:10:451
851899140,12cyclictest0-21swapper/100:30:191
851699148,5cyclictest0-21swapper/023:27:590
851699142,7cyclictest24660-21diskmemload23:50:010
851699142,7cyclictest24660-21diskmemload21:15:000
8516991411,2cyclictest31230-21kworker/u8:200:18:020
8516991411,2cyclictest30850-21kworker/u8:222:31:050
8516991411,2cyclictest22908-21kworker/u8:020:03:050
8516991411,2cyclictest21260-21kworker/u8:022:53:040
8516991411,2cyclictest13662-21kworker/u8:121:33:040
8516991411,2cyclictest10311-21kworker/u8:219:40:040
8516991411,2cyclictest10311-21kworker/u8:219:15:040
851699140,3cyclictest0-21swapper/000:33:330
851699140,2cyclictest0-21swapper/022:17:050
851699140,2cyclictest0-21swapper/000:11:040
851699140,13cyclictest0-21swapper/023:03:040
851699140,12cyclictest0-21swapper/022:58:460
851699140,12cyclictest0-21swapper/022:08:280
8520991310,2cyclictest24749-21ssh22:18:333
8520991310,2cyclictest0-21swapper/323:55:053
8520991310,2cyclictest0-21swapper/323:24:443
8520991310,2cyclictest0-21swapper/323:13:083
8520991310,2cyclictest0-21swapper/323:05:083
8520991310,2cyclictest0-21swapper/321:30:203
8520991310,2cyclictest0-21swapper/321:27:273
8520991310,2cyclictest0-21swapper/321:05:193
8520991310,2cyclictest0-21swapper/320:55:153
8520991310,2cyclictest0-21swapper/319:20:223
8520991310,2cyclictest0-21swapper/300:05:083
8520991310,2cyclictest0-21swapper/300:05:073
852099130,12cyclictest0-21swapper/323:35:143
852099130,12cyclictest0-21swapper/323:19:183
852099130,12cyclictest0-21swapper/322:25:213
852099130,12cyclictest0-21swapper/322:01:443
852099130,12cyclictest0-21swapper/321:48:333
852099130,12cyclictest0-21swapper/319:40:153
852099130,12cyclictest0-21swapper/300:17:463
852099130,12cyclictest0-21swapper/300:12:043
851999139,3cyclictest0-21swapper/223:57:372
851999138,3cyclictest3790-21ssh21:55:272
851999138,3cyclictest3790-21ssh21:55:272
851999138,3cyclictest13423-21ssh23:50:122
8519991310,2cyclictest0-21swapper/223:42:122
8519991310,2cyclictest0-21swapper/221:40:132
8519991310,2cyclictest0-21swapper/221:27:552
8519991310,2cyclictest0-21swapper/219:35:232
8519991310,2cyclictest0-21swapper/200:33:162
851999130,2cyclictest24660-21diskmemload22:10:052
851999130,2cyclictest0-21swapper/222:40:172
851999130,1cyclictest0-21swapper/222:05:262
851999130,12cyclictest0-21swapper/222:38:452
851999130,12cyclictest0-21swapper/221:10:062
851999130,12cyclictest0-21swapper/219:30:152
851999130,12cyclictest0-21swapper/200:20:362
851999130,12cyclictest0-21swapper/200:00:112
851999130,11cyclictest6145-21ssh21:24:412
851999130,11cyclictest0-21swapper/222:18:422
8518991310,2cyclictest24660-21diskmemload23:55:551
8518991310,2cyclictest24660-21diskmemload23:53:561
8518991310,2cyclictest0-21swapper/123:16:201
8518991310,2cyclictest0-21swapper/122:40:351
8518991310,2cyclictest0-21swapper/122:35:061
8518991310,2cyclictest0-21swapper/122:28:401
8518991310,2cyclictest0-21swapper/121:30:251
8518991310,2cyclictest0-21swapper/121:10:471
8518991310,2cyclictest0-21swapper/100:21:441
8518991310,2cyclictest0-21swapper/100:05:231
8518991310,2cyclictest0-21swapper/100:05:231
851899130,2cyclictest25606-21ssh23:28:161
851899130,2cyclictest24660-21diskmemload00:14:041
851899130,2cyclictest0-21swapper/122:50:221
851899130,2cyclictest0-21swapper/122:03:521
851899130,12cyclictest24660-21diskmemload22:09:511
851899130,12cyclictest0-21swapper/122:20:151
851899130,12cyclictest0-21swapper/121:15:181
851899130,12cyclictest0-21swapper/120:30:221
851899130,12cyclictest0-21swapper/100:35:181
851899130,12cyclictest0-21swapper/100:15:151
851899130,12cyclictest0-21swapper/100:00:141
851699132,6cyclictest0-21swapper/021:05:000
8516991310,2cyclictest8709-21kworker/u8:120:50:040
8516991310,2cyclictest8709-21kworker/u8:120:41:040
8516991310,2cyclictest4556-21kworker/u8:020:21:050
8516991310,2cyclictest28525-21kworker/u8:220:19:040
8516991310,2cyclictest10311-21kworker/u8:219:32:050
8516991310,2cyclictest0-21swapper/022:25:150
851699130,11cyclictest24660-21diskmemload21:28:180
851699130,11cyclictest0-21swapper/021:10:480
851699130,10cyclictest0-21swapper/022:40:050
110292130,2sleep20-21swapper/223:12:262
852099129,2cyclictest28525-21kworker/u8:220:06:053
852099129,2cyclictest0-21swapper/300:02:323
852099120,2cyclictest0-21swapper/323:30:043
852099120,2cyclictest0-21swapper/320:30:213
852099120,11cyclictest0-21swapper/320:50:183
851999129,2cyclictest0-21swapper/221:15:112
851999129,2cyclictest0-21swapper/220:22:162
851999129,2cyclictest0-21swapper/219:20:302
851999121,6cyclictest0-21swapper/220:50:002
851999120,2cyclictest0-21swapper/220:10:162
851999120,2cyclictest0-21swapper/220:00:122
851999120,11cyclictest0-21swapper/223:22:182
851999120,11cyclictest0-21swapper/222:00:212
851999120,11cyclictest0-21swapper/221:30:082
851999120,11cyclictest0-21swapper/220:35:132
851999120,11cyclictest0-21swapper/219:10:002
851999120,11cyclictest0-21swapper/200:10:372
851899120,11cyclictest0-21swapper/119:50:221
851899120,10cyclictest0-21swapper/120:20:161
851899120,10cyclictest0-21swapper/119:35:211
851699129,2cyclictest3862-21ssh23:40:080
851699129,2cyclictest24660-21diskmemload21:38:040
851699129,2cyclictest0-21swapper/000:25:140
851699120,2cyclictest0-21swapper/022:00:040
851699120,11cyclictest0-21swapper/000:20:190
278662120,8sleep228031-21ssh22:55:282
852099118,2cyclictest0-21swapper/320:40:193
851999118,2cyclictest0-21swapper/219:50:252
851999112,6cyclictest0-21swapper/220:32:592
851999112,5cyclictest0-21swapper/220:54:592
851999111,6cyclictest0-21swapper/219:20:012
851899118,2cyclictest13175-21munin-node1
851899110,3cyclictest0-21swapper/120:05:151
851899110,3cyclictest0-21swapper/119:25:161
851899110,2cyclictest0-21swapper/119:15:201
851899110,1cyclictest0-21swapper/119:45:171
851699110,2cyclictest0-21swapper/021:43:040
851699110,2cyclictest0-21swapper/019:45:050
852099107,2cyclictest0-21swapper/319:25:223
852099107,2cyclictest0-21swapper/319:15:123
852099100,9cyclictest0-21swapper/320:13:383
852099100,9cyclictest0-21swapper/319:55:023
851999105,3cyclictest31142-21cut20:05:142
851999102,6cyclictest0-21swapper/219:40:332
851899107,2cyclictest0-21swapper/121:00:171
851899107,2cyclictest0-21swapper/120:00:501
851899107,2cyclictest0-21swapper/119:40:161
851899106,3cyclictest0-21swapper/119:10:211
851899100,9cyclictest0-21swapper/120:15:271
851899100,3cyclictest0-21swapper/120:55:131
851899100,2cyclictest16790-21munin-node1
851899100,2cyclictest0-21swapper/120:45:191
851899100,2cyclictest0-21swapper/120:25:111
851699100,2cyclictest0-21swapper/020:55:120
192692100,1sleep20-21swapper/220:55:152
85209996,2cyclictest12809-21kworker/u8:019:30:053
85209996,2cyclictest10311-21kworker/u8:219:35:043
85209996,2cyclictest0-21swapper/320:49:593
85209996,2cyclictest0-21swapper/320:00:213
85209994,3cyclictest4508-21dbus-daemon21:00:093
85209991,6cyclictest9018-21cut19:10:153
85209990,8cyclictest0-21swapper/320:29:113
85199994,3cyclictest8032-21grep20:25:252
85199994,3cyclictest13476-21latency20:40:172
85199993,4cyclictest23448-21grep19:45:172
85199990,8cyclictest0-21swapper/221:09:462
85189996,2cyclictest10738-21apt-get20:35:131
85189990,8cyclictest0-21swapper/119:55:141
85189990,2cyclictest0-21swapper/121:05:251
12297290,2sleep30-21swapper/320:37:083
85209985,2cyclictest0-21swapper/320:15:193
85209980,2cyclictest0-21swapper/319:46:503
85199983,3cyclictest15544-21sed19:25:182
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional