Activation function: Revision history

Filter revisionsshowhide

To date:

Tag filter:

Invert selection

External tools:

For any version listed below, click on its date to view it. For more help, see Help:Page history and Help:Edit summary. (cur) = difference from current version, (prev) = difference from preceding version, m = minor edit, → = section edit, ← = automatic edit summary

curprev 05:3505:35, 26 April 2025 Cosmia Nebula talk contribs 25,373 bytes +142 →Table of activation functions: softsign undo Tag: Visual edit

curprev 02:1902:19, 18 April 2025 Citation bot talk contribs 25,231 bytes −38 Removed URL that duplicated identifier. | Use this bot. Report bugs. | Suggested by Dominic3203 | Linked from User:LinguisticMystic/cs/outline | #UCB_webform_linked 13/2277 undo

curprev 13:2613:26, 16 April 2025 Citation bot talk contribs 25,269 bytes −49 Add: arxiv, authors 1-1. Removed parameters. Some additions/deletions were parameter name changes. | Use this bot. Report bugs. | Suggested by Dominic3203 | Linked from User:LinguisticMystic/cs/outline | #UCB_webform_linked 13/2277 undo

curprev 00:3500:35, 21 February 2025 Cosmia Nebula talk contribs 25,318 bytes +19 →Table of activation functions: link to Swish function undo Tag: Visual edit

curprev 23:0023:00, 18 February 2025 BilCat talk contribs m 25,299 bytes +39 Rvv undo Tag: Rollback
curprev 09:5209:52, 18 February 2025 75.85.165.136 talk 25,260 bytes −39 No edit summary undo Tag: Reverted
curprev 09:5009:50, 18 February 2025 75.85.165.136 talk 25,299 bytes −4 No edit summary undo Tags: Manual revert Reverted
curprev 09:4909:49, 18 February 2025 75.85.165.136 talk 25,303 bytes +4 No edit summary undo Tag: Reverted

curprev 07:4507:45, 29 January 2025 Sempiternalis talk contribs m 25,299 bytes +77 Added links between established Wikipedia pages. undo Tag: Visual edit

curprev 22:1622:16, 27 January 2025 Cosmia Nebula talk contribs 25,222 bytes +304 →Further reading undo Tag: 2017 wikitext editor
curprev 21:4821:48, 27 January 2025 Cosmia Nebula talk contribs 24,918 bytes −658 →Table of activation functions undo Tag: Visual edit
curprev 21:4521:45, 27 January 2025 Cosmia Nebula talk contribs 25,576 bytes +632 →Table of activation functions: swiglu undo Tag: Visual edit
curprev 21:4221:42, 27 January 2025 Cosmia Nebula talk contribs 24,944 bytes +128 →Table of activation functions: swiglu undo Tag: Visual edit

curprev 22:3822:38, 24 January 2025 Jlin talk contribs 24,816 bytes +16 Split "modern activation functions" into its own paragraph and reordered the functions, putting GELU after ReLU. undo

curprev 03:1503:15, 9 January 2025 Hellacioussatyr talk contribs 24,800 bytes +158 →Table of activation functions undo Tags: Mobile edit Mobile web edit Advanced mobile edit

curprev 00:4200:42, 25 December 2024 Cewbot talk contribs m 24,642 bytes −18 Fixing broken anchor: #Order of continuity→most alike anchor Smoothness#Continuity undo

curprev 19:4219:42, 12 December 2024 Citation bot talk contribs 24,660 bytes +12 Add: pmid, doi, pages, volume. Removed URL that duplicated identifier. Removed access-date with no URL. | Use this bot. Report bugs. | Suggested by Dominic3203 | Category:Artificial neural networks | #UCB_Category 99/155 undo

curprev 19:1219:12, 6 December 2024 Viktor Guer talk contribs 24,648 bytes +2 →Further reading undo

curprev 07:2807:28, 22 November 2024 Kadulous talk contribs m 24,646 bytes −1 made equation more consistent with other equations where x<0 comes before x>=0 undo Tag: Visual edit
curprev 07:1207:12, 22 November 2024 Kadulous talk contribs 24,647 bytes +374 Filled in empty cells for ELiSH undo Tag: Visual edit

curprev 21:2921:29, 14 November 2024 Viktor Guer talk contribs 24,273 bytes +5 →Further reading undo

curprev 20:3820:38, 6 November 2024 OAbot talk contribs m 24,268 bytes +18 Open access bot: arxiv updated in citation with #oabot. undo

curprev 15:3315:33, 13 October 2024 Atto.AM talk contribs m 24,250 bytes +5 Correction: 5 parameters instead of 4 undo
curprev 15:3115:31, 13 October 2024 Atto.AM talk contribs m 24,245 bytes −27 Removal of unnecessary information undo
curprev 15:2715:27, 13 October 2024 Atto.AM talk contribs m 24,272 bytes +1,015 Add-on: the most flexible activation function available, thanks to its 4 parameters undo

curprev 04:2704:27, 9 October 2024 Citation bot talk contribs 23,257 bytes +131 Altered template type. Add: class, eprint, volume, series, arxiv, bibcode, authors 1-1. Removed parameters. Some additions/deletions were parameter name changes. | Use this bot. Report bugs. | Suggested by Dominic3203 | #UCB_webform 63/199 undo

curprev 20:5420:54, 9 September 2024 Cosmia Nebula talk contribs 20,404 bytes −30 →Folding activation functions: link to pooling undo Tag: Visual edit

curprev 13:4213:42, 5 July 2024 2409:40e1:23:4bf:1ea9:50a0:a6da:bc98 talk 20,434 bytes +40 →Mathematical details: It was written in an unprofessional way, without properly explaining. undo

curprev 07:2907:29, 10 May 2024 Kku talk contribs m 20,394 bytes +4 link speech recognition undo

curprev 03:2803:28, 4 May 2024 Citation bot talk contribs 20,390 bytes +75 Add: bibcode, isbn, pages, authors 1-1. Removed parameters. Some additions/deletions were parameter name changes. | Use this bot. Report bugs. | Suggested by Dominic3203 | Category:Artificial neural networks | #UCB_Category 96/159 undo

curprev 19:3519:35, 26 April 2024 Funcs talk contribs 20,315 bytes +840 References undo Tag: Visual edit

curprev 17:0017:00, 25 April 2024 38.29.192.250 talk 19,475 bytes −6 →Mathematical details undo

curprev 19:2719:27, 11 March 2024 MrOllie talk contribs 19,481 bytes −350 Restored revision 1212187498 by Techimanz (talk): Rv arxiv preprint as source undo Tags: Twinkle Undo
curprev 19:1619:16, 11 March 2024 PteroBacter talk contribs 19,831 bytes +350 A quantification of available activation functions in the literature was added, including a reference listing all those functions. I have found it useful and I feel that it helps the reader to see that the problematic of activation functions is much wider than it might seem from the list but, unlike listing more activation functions in the table, it does not make the article unreadable or too complicated - e.g., as was the revision 966535343. Interested readers may follow the ref. undo Tag: Reverted

curprev 15:2415:24, 6 March 2024 Techimanz talk contribs m 19,481 bytes +21 sigmoid Wikilink add undo Tags: Visual edit Mobile edit Mobile web edit Advanced mobile edit
curprev 15:2215:22, 6 March 2024 Techimanz talk contribs m 19,460 bytes +32 Added link relu to wiki page undo Tags: Visual edit Mobile edit Mobile web edit Advanced mobile edit

curprev 12:4612:46, 20 January 2024 Justinkunimune talk contribs 19,428 bytes +14 copyedit lede for clarity undo

curprev 22:0722:07, 29 November 2023 Nabla talk contribs 19,414 bytes +71 →Ridge activation functions: Clarify: what is a? what is v'? what is b? undo

curprev 22:3822:38, 5 November 2023 Yoshi24517 talk contribs m 19,343 bytes +3,945 Reverted edits by 41.108.234.66 (talk) (HG) (3.4.12) undo Tags: Huggle Rollback
curprev 22:3722:37, 5 November 2023 41.108.234.66 talk 15,398 bytes −3,945 →Table of activation functions undo Tags: Reverted Visual edit

26 April 2025

18 April 2025

16 April 2025

21 February 2025

18 February 2025

29 January 2025

27 January 2025

24 January 2025

9 January 2025

25 December 2024

12 December 2024

6 December 2024

22 November 2024

14 November 2024

6 November 2024

13 October 2024

9 October 2024

5 October 2024

9 September 2024

5 July 2024

10 May 2024

4 May 2024

26 April 2024

25 April 2024

11 March 2024

6 March 2024

20 January 2024

29 November 2023

5 November 2023

5 October 2023